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Method and Apparatus For Case-Based Learning 

This is a continuation, entitled to benefit under 35 U.S.C. 120, of the 
following U.S. Patent Application that is herein incorporated by reference: 
5 "Method and Apparatus For Solving Constraints," filed on August 16, 

2003, having inventor Mahesh A. Iyer, filed with a docket number of 06816.0506 
and having U.S. Patent Office Application No. 10/641,845. 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application is related to the following U.S. patent application, that is 
herein incorporated by reference: 

"Method and Apparatus For Solving Bit-Slice Operators," filed with 
Express Mail No. EU893-957-181US on the same date as the present 
application, having inventor Mahesh A. Iyer, a docket number of 
06816.0506CON2 and U.S. Patent Office Application No. to be determined. 

FIELD OF THE INVENTION 

The present invention relates generally to the solution of sets of 
constraints, and more particularly to the solution of sets of constraints in 
20 connection with the generation of random test data. 

BACKGROUND OF THE INVENTION 

Random test data has a wide variety of uses. A particularly important 
application of random test data is in the verification of digital electronic circuits in 
25 order to exercise a wide variety of circuit paths for possible faults. 

To tackle the increasing complexity of integrated digital electronic circuits, 
designers need faster and more accurate methods for verifying the functionality 
and timing of such circuits, particularly in light of the need for ever-shrinking 
product development times. 
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The complexity of designing such circuits is often handled by expressing 
the design in a high-level hardware description language (HLHDL). The HLHDL 
description is then converted into a physical circuit specification through 
processes, well known to those of ordinary skill in the art as "synthesis," involving 
5 translation and optimization. Examples of an HLHDL are: 

1. IEEE Standard 1364-2001, for the Verilog Hardware Description 

Language. The Institute of Electrical and Electronics Engineers, 
Inc., 345 East 47 th Street, New York, NY 10017-2394, USA. 

2. IEEE Standard 1076-1993, for the VHDL Hardware Description 

10 Language. ISBN: 1559373768, August 1994. The Institute of 

Electrical and Electronics Engineers, Inc., 345 East 47 th Street, 
New York, NY 10017-2394, USA. 
An HLHDL description can be verified by simulating the HLHDL 
description itself, without translating the HLHDL to a lower-level implementation. 
1 5 This simulation is subjected to certain test data and the simulation's responses 
are recorded or analyzed. 

Verification of the HLHDL description is important since detecting a circuit 
problem early prevents the expenditure of valuable designer time on achieving 
an efficient circuit implementation for a design which, at a higher level, will not 
20 achieve its intended purpose. In addition, simulation of the design under 

verification (DUV) can be accomplished much more quickly in an HLHDL than 
after the DUV has been translated into a lower-level, more circuit-oriented (e.g., 
gate-level) implementation. 

The verification of HLHDL descriptions has been aided through the 
25 development of Hardware Verification Languages (or HVLs). An HVL can be 
implemented and supported by a test-bench automation (TBA) tool. Among 
other goals, HVLs are intended to provide programming constructs and 
capabilities which are more closely matched to the task of modeling the 
environment of an HLHDL design than are, for example, the HLHDL itself or 
30 software-oriented programming languages (such as C or C++). HVLs permit a 
DUV, particularly those DUVs expressed in an HLHDL, to be tested by 
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stimulating certain inputs of the DUV and monitoring the resulting states of the 
DUV. 

Most HVLs include a programming mechanism by which to specify 
constraints on a set of variables. Constraints have the advantage of permitting 

5 "legal" sets of inputs to a DUV (i.e., inputs to the DUV that simulate the DUVs 
environmental restrictions) to be specified in a declarative programming manner 
that is often easier to specify than, for example, a procedural approach. Such 
randomly selected solutions to these constraints can be used to provide stimulus 
to the DUV. Consequently, there is a need for an efficient constraints solving 

1 0 system for use with TBA tools. 

A high-level view of this commonly used functional verification 
methodology is depicted in Figure 1 . 

The high-level test bench is written in an HVL, that is supported by the 
underlying TBA tool, and has two main goals. First, the test bench seeks to 

1 5 apply random stimulus and/or directed tests to the DUV by interfacing to a 

simulator. Second, the test bench seeks to analyze results from the simulation 
by performing assertion checking and by measuring the functional coverage. 
Most designs have assumptions on how they interact with their environment. A 
goal of the test-bench is to generate random stimuli to the DUV that satisfy these 

20 environmental restrictions. Consequently, most commercial and industry- 
standard HVLs provide means to specify constraints on certain variables (that 
are declared within the test-bench) and the ability to randomize a certain set of 
these variables upon demand. The constraints themselves could be arbitrary 
expressions on signed or unsigned variables with varying bit-widths using the 

25 high-level operators supported by the HVL. The results of the randomization 
specified by the test-bench are translated (through procedural code within the 
test-bench) by the TBA tool into legal random stimuli to the DUV. When control is 
handed over to the simulator of the DUV, the effect of the newly-generated 
stimulus from the TBA tool is simulated until there are no more events for the 

30 simulator in the current clock cycle. At this point, control is handed back to the 
test-bench, which does assertion checking for the truth of certain properties 
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(based on the current signal values of the DUV) and measures functional 
coverage (as defined by test-bench criteria). In addition, the test bench can 
receive feedback from the DUV, in the form of state variables (sv's), that it uses 
to adaptively adjust the course of its test generation. The constraints in the test- 
5 bench can also contain test-bench state variables (sv's). The test-bench, 

through the TBA tool, then generates the next set of random stimuli to the DUV, 
by finding a solution to the random variables of its constraints, given the current 
values for the sv's, and the process continues, until the test-bench finishes. 
While constraints provide a powerful specification language, for such 
10 applications as design verification, finding an assignment to their variables that 
satisfies them can be complex. It is therefore desirable to have improved 
methods for finding solutions to a constraint or a set of constraints. 



SUMMARY OF THE INVENTION 

1 5 Summary of Problem and Representation 

The present invention comprises the following types of techniques for 
word-level networks: combinational constraint expression solving, case-based 
learning and bit-slice solving. 

The constraint expressions are parsed into a high-level constraint 
20 representation (i.e., the word-level network) upon which is operated a branch- 
and-bound algorithm that randomly selects solutions. 

A constraint is any expression that evaluates to a Boolean value (i.e., 
either TRUE or FALSE). 

The constraint solving problem comprises finding legal assignments to all 
25 random variables (or rv's) in V, given the particular values currently assigned to 
the state variables (or sv's in V, such that all the constraints in C are satisfied. 

From an input set of constraints to be solved, a high-level representation, 
referred to herein as the "constraint set representation," is determined. The 
constraint set representation utilized by the present invention is a word-level 
30 network in which each operator, represented by a node, can propagate values 
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that are not restricted to being just one or zero. The word-level nature of the 
networks addressed by the present invention permits it to more fully and 
efficiently explore the search space of a particular network than in prior 
approaches that focus upon single-bit-level networks. 

The word-level networks addressed by the present invention can be in the 
form of a directed acyclic graph (DAG), with each high-level operator and 
operand (both constants and variables) of a constraint represented as a node. 

In general, the term "justification" is used to refer to the process of 
determining legal values, without any uncertainty. When an input constraint set 
problem is satisfied by determining legal values to all random variables, all nodes 
in the constraint set representation are justified. The term "justified" is also 
defined below as it applies to Boolean nodes, with such nodes being called 
"justified Boolean nodes" or "unjustified Boolean nodes." 

There is a node in the constraint set representation for each of the 
following: i) a leaf-level node for each operand to a constraint, including input 
variables and constants (variables that participate in multiple constraints have 
multiple fanouts in the constraint set representation); ii) a root-level node for the 
output (which is an AND node in the case of multiple constraints); and iii) a node 
for each operator of a constraint, located between the leaf nodes and the 
root-level node. 

Each node of a constraint set representation is assigned a range of 
permissible values, indicated by a data structure referred to herein as a "range." 
A range is comprised of a set of one or more "intervals." An interval is a set of 
contiguous, monotonically increasing, integer values, defined (inclusively) by a 
low value and a high value. 

For each operator of the HVL (in which the input constraint set to be 
solved is written), algorithms for implication (such implication process addressed 
in detail below) using the above-defined range data structure are implemented. 

For some constraint set representations involving certain types of 
operators, were the implication process to be pursued completely, some of the 
ranges could result in containing an excessive number of intervals. Such 
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excessive number of intervals is due to the absence of an "x" value that can 
compactly express certain repetitive "gaps" in the range associated with a node 
of the constraint set representation. An approach of the present invention, for 
reducing the number of intervals needed to represent such repetitive gaps, is to 

5 produce an over-approximated range (i.e., a range that may contain values that 
cannot be part of a solution to the input constraint set). While an 
over-approximated range is a potential problem, in terms of increasing the 
amount of searching that the present invention must do in order to find a 
solution, such increased search possibilities are managed by heuristic 

10 techniques (such as iterative relaxation), and efficient backtracking (with such 
techniques as interval splitting), described below. 

Summary of Constraints Solving 

1 5 A core sub-system of the present invention is a fast implication engine. In 

general, the implication engine explores implications: the extent to which a range 
at a node of the constraint set representation can be further limited as a 
deductive consequence of range values at other nodes of the constraint set 
representation. 

20 The implication engine is referred to as an "implication process." 

The constraints solving process begins by performing an implication 

process based upon the initial state of the constraint set representation. Such 

implication process may include any or all of the following techniques: forward 

implication, backward implication, and case based learning. These implication 
25 techniques are described in more detail below. If a conflict results from the 

implication process, then a solution to the input constraint set does not exist and 

a value of FAILURE is returned. 

If the implication process does not end in failure, however, then all the 

random variables (rv's) of the constraint set representation that are not currently 
30 limited to a single value (referred to herein as an "available" rv), need to be 

identified such that, from among such available rv's, a current decision variable 
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(dv) can be selected. Note that if there are no available rv's, then all the rv's 
have been limited to a single value and a solution to the input constraint set has 
been found. The finding of a solution to the input constraint set is indicated by 
the procedure returning SUCCESS. The selection of a current dv, from among 
the available rv's, can be accomplished according to a variety of different 
algorithms. A first approach is to select the current dv at random. A second 
approach is to compute a cost function, for each available rv, that is a metric of 
its desirability as a dv. 

Once a current dv has been selected, the next step is to limit the range of 
the current dv to encompass a single value. Such range limitation of the dv may 
be performed gradually, using such techniques as iterative relaxation. Iterative 
relaxation is presented in more detail below. 

Once a value has been selected for the current dv, implications are 
performed on the constraint set representation. This may include any or all of 
the following techniques: forward implication, backward implication, and case 
based learning. 

If no conflict results from the implication process, then the procedure 
continues with picking the next current dv. 

However, if a conflict does result from the implication process, the 
procedure will remove the value causing the conflict from the range of the current 
dv, by splitting the previous range value of the dv and doing an implication 
process to gain any implications resulting from the additional range splitting. A 
range is considered split if it has more than one interval. Also, in case of a 
conflict from the implication process, the procedure will backtrack by limiting the 
current dv to another single value of its range and performing the implication 
process once again. If, however, all the single values for the current dv have 
been exhausted, the procedure will next try backtracking to the previously current 
dv and try to limit that previously current dv to another single value of its range 
than had previously been settled upon. If, however, there is no previously 
current dv to backtrack to, then the procedure ends in FAILURE. 
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Further details of the basic constraint-solving process are presented 

below. 

Summary of Implication Process 

5 For each operator of the constraint specification language, algorithms are 

implemented to perform any or all of the following across its constraint 
representation node: forward and backward implications. For certain operators 
like Boolean nodes, algorithms are also implemented to perform case-based 
learning which, in general, lead to more implications. 

10 In general, forward implication across an operator node is the process of 

determining a value range for that node's output using the value ranges of all its 
input nodes and the semantic functionality of that operator. For example, 
consider an adder with two 4-bit unsigned inputs that have value ranges {0:15} 
and {5:10}. The output of this adder is evaluated and represented in 5-bit 

1 5 precision with the value range {5:25}. Note that for many operators (for example 
Boolean, relational and unary reduction operators), the output node value range 
can be either {0:0}, {1:1}, or {0:1}. 

In general, backward implication, to an input of an operator node, is the 
process of determining a range on that input using the ranges of other inputs of 

20 that operator node, the range of the output of that node and the semantic 
functionality of the operator. 

Section 4.1 contains an example pseudo-code embodiment for top-level 
functionality of the implication engine. Section 4.2 contains an example pseudo- 
code embodiment for the discussed forward implication process, while Section 

25 4.3 contains an example pseudo-code embodiment for the discussed backward 
implication process. Section 4.7 contains example pseudo-code that customizes 
the pseudo-code to specific operators. 

Section 4.1 defines a procedure named "ImplyValueslnCircuitFe." The 
Te" of ImplyValueslnCircuitFe stands for "front end," and ImplyValueslnCircuitFe 

30 is an embodiment of an overall implication process that proceeds until the 
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possible implications of a given constraint set representation has been 
converged upon. 

ImplyValueslnCircuitFe calls the functions Fowardlmply and 
Backward Imply. 

5 Section 4.2 defines a procedure named "Fowardlmply." 

Section 4.3 defines a procedure named "Backward Imply." 
The pseudo-code of Section 4.7 is utilized, on an operator-specific basis, 
by Forwardlmply and Backwardlmply. 

1 0 Summary of Case-Based Learning 

Case-based learning explores implications using case-analysis on 
unjustified Boolean nodes. In general, the implication results on a variable node, 
for each case analyzed, are accumulated and the union represents the legal 
possible values for that variable. 
15 The case-based learning technique described below is generally 

applicable to the annotation of word-level networks and is not limited to 
word-level networks as used for constraint set solving. 

The Boolean nodes considered for case-based analysis are AND (&&) 
and OR (||). 

20 The output of a Boolean node is said to have a controlling value if its 

range is {1 :1} for an OR node and {0:0} for an AND node. The range of an input 
of an OR node is said to only contain values classified as controlling if its range 
only contains values that do not include {0:0}. The range of an input of an AND 
node is said to only contain values classified as controlling if its range only 

25 contains {0:0}. The range of an input of an AND node is said to only contain 
values classified as non-controlling if its range only contains values that do not 
include {0:0}. The range of an input of an OR node is said to only contain values 
classified as non-controlling if its range only contains {0:0}. 

An unjustified Boolean node (or UBN) is a Boolean node whose output 

30 range has a controlling value ({1 :1} for OR node and {0:0} for AND node) and the 
range of each input has both controlling and non-controlling values. A Boolean 
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node that does not satisfy this definition of unjustified is classified as a justified 
Boolean node. 

For an unjustified Boolean node, it is known that the output of the node 
has been put to a controlling value by at least one of the inputs, but it is not 
5 known which input or inputs will cause such controlling output value. Therefore, 
unjustified Boolean nodes can be subjected to case analysis, in which, one-by- 
one, each of the Boolean node's inputs is assumed to have a controlling value. 
The implications, resulting from such controlling value assumption, are explored. 

Section 4.4 presents a pseudo-code description of the case-based 
10 learning technique. 

The main case-based learning procedure of Section 4.4 is 
PerformLearninglnCircuitFe. PerformLearninglnCircuitFe iterates over each 
unjustified Boolean node (UBN) of the raceCircuit, referred to herein as the 
current UBN, and invokes the procedure PerformLearninglnCircuit upon the 
15 current UBN. If the case-based learning succeeded in yielding additional 
information then an implication process is performed using 
ImplyValueslnCircuitFe. 

The procedure PerformLearninglnCircuit makes a distinction between 
what is called "recursive learning" and what is referred to as "global learning." 
20 When the inputs to an unjustified Boolean node are each assumed to 

have a controlling value, and when such assumption leads to the input also 
being an unjustified Boolean node, then recursive learning is said to have 
occurred. 

Global learning occurs when, as a result of the input constraint set, at 
25 least two nodes are unjustified. Assuming, for example, a constraint set 

representation in which there are two initial unjustified nodes V and "w," and 
that both node "v" and node "w" are explored for combinations of having an input 
with a controlling value, then global learning is said to be performed. 

An overview of PerformLearninglnCircuit, as it can operate once called by 
30 PerformLearninglnCircuitFe, is as follows. 
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PerformLearninglnCircuit iterates over each input to the current UBN 
passed to it by PerformLearninglnCircuitFe, each such input referred to as the 
current UBN input. For each current UBN input, it is set to a controlling value 
and then RecursivelmplyDecisionValue is called. RecursivelmplyDecisionValue 

5 performs three sequential child invocations, which shall be referred to herein as 
phases. The second and third phases each comprise an invocation of 
RecursiveLearnAnd Imply followed by a recursive invocation of 
PerformLearninglnCircuit. The recursive invocation of PerformLearninglnCircuit 
for the second phase, and all child processes invoked as a result of it, complete 

10 before the third phase begins. 

In the first phase, RecursivelmplyDecisionValue calls 
ImplyValueslnCircuitFe, an implication process that determines the implications, 
if any, of setting the current UBN input to a controlling value. 

In the second phase, RecursivelmplyDecisionValue creates a list of the 

1 5 UBN's in the constraint set representation (the list referred to as unjustNodes), 
that excludes the current UBN but includes UBN's resulting from an invocation of 
PerformLearninglnCircuit setting a current UBN input to a controlling value. 
RecursivelmplyDecisionValue then calls RecursiveLearnAndlmply with 
unjustNodes as a parameter. RecursiveLearnAndlmply iterates over each UBN 

20 of unjustNodes, recursively invoking PerformLearninglnCircuit on each such 
node. Recursive learning occurs where a recursive invocation of 
PerformLearninglnCircuit is applied to a node that became a UBN as a result of 
a controlling value being applied to a current UBN input by a prior invocation of 
PerformLearninglnCircuit. 

25 The third phase for RecursivelmplyDecisionValue is similar to the second 

phase. As in the second phase, an unjustNodes list is created. However, the 
unjustNodes list of the third phase includes all UBN's of the constraint set 
representation. Thus, the unjustNodes list of the third phase includes UBN's, 
other than the current UBN, that result from the input constraint set itself. 

30 RecursivelmplyDecisionValue then calls RecursiveLearnAndlmply with 

unjustNodes as a parameter. RecursiveLearnAndlmply iterates over each UBN 
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of unjustNodes, recursively invoking PerformLearninglnCircuit on each such 
node. Global learning occurs where the recursive invocation of 
PerformLearninglnCircuit is applied to a node that is a UBN as a result of the 
input constraint set, independent of dynamic assumptions that have been made 
by invocations of PerformLearninglnCircuit. 

In general, as discussed above, the case-based learning technique 
described below is generally applicable to the annotation of word-level networks. 
Other applications in which the processing of word-level network can be 
optimized as a result of such annotation include the following: hardware design 
synthesis, automatic test pattern generation (ATPG), and formal circuit analysis. 

Summary of Decision Variable Selection and Limitation 

Embodiments of the invention pick from among the available primary-input 
random variables to select the current decision variable (dv). Even when user- 
defined variable priorities are supported by embodiments of the invention, there 
can still be multiple available variables at the same priority. In such a case, it 
may be preferable to determine a cost function to decide which variable to pick 
first for assignment. 

Section 4.5 presents a pseudo-code procedure to compute a cost 
function. 

Once a current dv has been picked, the next problem is to limit its range 
to a single value that can be part of a solution to the input constraint set. This 
can be accomplished as follows. 

From the range of the current dv, an interval is randomly selected, that 
shall be referred to as the current interval. 

If the cardinality of the current interval is sufficiently small, then a value 
from the interval can be selected at random. If the cardinality of the current 
interval is too large, the following iterative relaxation procedure can be used to 
reduce its cardinality before selection of a single value is performed. 

First, the current interval is divided into a pre-determined number of 
smaller intervals. In some embodiments, the iterative relaxation procedure 
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divides the current interval into two approximately equal-sized intervals. Then, 
iteratively, one of the smaller intervals is picked at random as the new current 
interval. 

If the smaller intervals, available for selection as a new current interval, 
5 have been exhausted, then either iterative relaxation ends in failing to find an 
acceptable value, or it returns from the current recursion level. The return from 
the current recursion goes back to the step, of the higher level invocation, of 
iteratively selecting one of the smaller intervals such that another such smaller 
interval can be tried. 

10 If, however, the smaller intervals, available for selection as a new current 

interval, have not been exhausted, then the iterative relaxation process 
continues by performing an implication process. The implication process finds 
any implications resulting from the limiting of the current interval to the new 
current interval. If a conflict results from such implication process, then it is 

15 known that, for the entire current interval, there is no valid single value that can 
be chosen. In this situation, one of the other smaller intervals is selected instead 
and the same process, of determining whether there are any valid values to be 
chosen in the new current interval, is repeated. If a conflict does not result from 
the implication process upon the new current interval, then the process recurses, 

20 with the current interval of the recursive invocation being the new current interval. 

The recursive invocation begins with dividing the current interval (now the 
new current interval) into smaller intervals. Eventually, when the iterative 
relaxation search procedure has selected a current interval of sufficiently small 
size, a value of the current interval is randomly selected. 

25 A pseudo-code procedure for iterative relaxation is depicted in Section 

4.6. 

Summary of Techniques to Handle Interval Cardinality and Bit Slice 
Operator 

30 The implication algorithms of the implication process can be conservative, 

in the sense that when a compact range representation cannot be derived (either 
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because of difficulties in crafting an algorithm for implication involving a particular 
operator or because the interval-cardinality of the resulting range would be too 
large), the implication process returns a broad range for the node, often limited 
only by the node's basic limitations of precision and sign. This approach is 
5 conservative since it only excludes those values from a range that have been 
definitely determined as not part of any solution to the input constraint set. 

Note that while this approach sometimes leads to the retention of values 
known not to be part of a solution, such retention does not introduce serious 
performance issues, for many example input constraint sets, for at least the two 

10 following reasons. First, once a range is limited to a specific value, the constraint 
set representation is re-solved, through another application of the implication 
process, such that the selection of a value, which cannot be part of a solution, 
will be detected as introducing a conflict. Second, heuristic techniques, such as 
iterative relaxation, permit the present invention to efficiently handle ranges with 

1 5 large value-cardinality. 

As with case-based learning described above, the backward implication 
bit-slice technique described below is generally applicable to the annotation of 
word-level networks and is not limited to word-level networks as used for 
constraint set solving. 

20 For some operators backward implication is limited either because of 

algorithmic complexities or because of interval-cardinality explosion. For 
example, using a two-value data representation, it can be hard to perform 
backward implication across a bit slice operator. A bit-slice operator takes an 
input variable and selects, for output, the value of a range of bits of the input 

25 variable, where the range is specified by two other inputs to the bit-slice 
operator. 

In the case of the bit-slice operator, and also in the case of the modulo 
operator example, interval-cardinality can be reduced through introduction of an 
unknown (or "x") value in a range's representation. Another approach, however, 
30 is performing a conservative backward implication during a typical implication 
process (e.g., the maximum range for "a" is intersected with the current range 
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for "a'). However, when an implication process is begun, where the range for 
variable "a" is limited to encompass a single value, the value is selected such 
that it at least satisfies the bit-slice constraints, which minimizes the amount of 
backtracking performed in finding a solution to the input constraint set. 
5 A procedure is described to efficiently support the determination of a 

value for a node, of a word-level network, that is an operand of several bit-slice 
operators. This procedure ensures that a range of values, evaluated for such an 
operand node, satisfies at least all the bit-slice operators for which it is an 
operand. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, that are incorporated in and constitute a 
part of this specification, illustrate several embodiments of the invention and, 
together with the description, serve to explain the principles of the invention: 
15 Figure 1 depicts a high-level view of a commonly used functional 

verification methodology; 

Figure 2 depicts an example constraint set representation, with initial 
range assignments shown; 

Figure 3 depicts an overview of the overall semi-deterministic constraints 
20 solving process; 

Figure 4 depicts an example constraint set representation to illustrate 
case-based learning; 

Figure 5 depicts an example constraint set representation to illustrate the 
need for interval-cardinality limitation of certain ranges; 
25 Figures 6A-6B depict an example to illustrate cyclic behavior during the 

implication process; 

Figure 7 depicts an example to illustrate implications across a bit slice 
operator; 

Figure 8 depicts a generalized example of three bit-slice constraints for 
30 various overlapping bits of an n-bit variable; 



Page 16 of 97 



Express Mail Number EU893-957-195US 

M.A. Iyer 

Figure 9 depicts a specific example of three overlapping bit-slice 
constraints of a 14-bit variable; 

Figures 10A-10F depict a constraint set representation, for an example 
set of constraints, with respect to its unjustified Boolean nodes and implications 
5 resulting from them; 

Figures 1 1 A-1 1 B depict a constraint set representation, for an example 
set of constraints, with respect to a constraint that relies upon a justified Boolean 
node; 

Figure 12 depicts a process for satisfying bit-slice constraints; 
1 0 Figures 1 3A-1 3B depict processes for case-based learning; 

Figure 14 illustrates a process for iterative relaxation; and 
Figure 15 shows a computing hardware environment within which to 
operate the present invention. 

1 5 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference will now be made in detail to preferred embodiments of the 
invention, examples of which are illustrated in the accompanying drawings. 
Wherever possible, the same reference numbers will be used throughout the 
drawings to refer to the same or like parts. 

20 This specification contains pseudo-code to illustrate several embodiments 

of the invention and to explain its principles. The pseudo-code is loosely based 
upon the C and C++ programming languages. The C and C++ programming 
languages are described in such texts as "The C Programming Language", by B. 
W. Kernighan and D. M. Ritchie, Prentice Hall, Inc., 1988, ISBN 0-13-110362-8 

25 (paperback), 0-1 3-1 1 0370-9 (hardback) and "The C++ Programming Language," 
by Bjarne Stroustrup, Addison-Wesley Pub. Co., 3rd edition, July 1997, ISBN 0- 
2018-8954-4, which are herein incorporated by reference. 



30 
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5. HARDWARE ENVIRONMENT 

1. Problem Formulation 

35 The present invention comprises techniques for solving combinational 

constraint expressions. The constraint expressions are parsed into a high-level 
constraint representation (i.e., a word-level network) upon which is operated a 
branch-and-bound algorithm that randomly selects solutions. In general, a 
decision to limit a random variable to fewer values corresponds to a branch 

40 decision, while the bound process makes sure that the implications of a branch 
decision are consistent with the constraints. 
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In addition, the present invention comprises techniques, that while useful 
for the solving of combinational constraint expressions, also have wider 
applicability to the annotation of word-level networks. These techniques include: 
case-based learning and the solving of multiple bit-slice operators. 
5 The combinational constraints solving problem can be formulated as 

follows. Consider a set of variables, V = {v1, v2, vn} 3 and a set of relations or 
constraints, C = {d, c2, cm}, such that each constraint is a relation between 
expressions over a subset of the variables in V. A constraint is any expression 
that evaluates to a Boolean value (i.e., either TRUE or FALSE). In this context, 

10 an expression is any legal sequence of variables and operators, as defined in the 
language used to express the constraints. 

Each variable in V has a defined bit-width and sign that determine a range 
of values that can possibly be assigned to it. A variable in Vcan be random or 
state. A random variable (or rv) can be defined as taking on, at the appropriate 

1 5 point in the execution of an HVL program, a value that is randomly selected from 
its range, such that all the active constraints that the variable participates in are 
satisfied. A state variable (or sv) is similar to an "ordinary" programming 
language variable, i.e., it is a variable whose value is set by the various 
assignment constructs of the HVL. In addition to being a function of the HVL 

20 ' program itself, a state variable can also represent feedback from the DUV that is 
used by the HVL program to adapt the further course of testing. 

The expressions of a constraint can employ a variety of operators, 
including arithmetic, Boolean, relational, unary reduction, bit-wise, shift, 
concatenation, bit slice, implication, and ternary multiplexing. 

25 The constraint solving problem comprises finding legal assignments to all 

random variables (or rv's) in V, given the particular values currently assigned to 
the state variables (or sv's in V, such that all the constraints in C are satisfied. 

Consider the following constraint solving problem, labeled Example 1, that 
is written in the OpenVera High Level Verification Language (also referred to 

30 herein as "Vera"), a product of Synopsys, Inc., Mountain View, CA, USA: 
Example 1: 
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rand bit[3:0] a, b; 
rand integer c; 
constraint c1 { 
a + b == c * 2; 
5 } 

constraint c2 { 

c> 0; 

} 

Here "a" and "o"are 4-bit unsigned random variables and "c"is a 32-bit 

10 signed random variable. Thus, "a," "b," and "c"can possibly take, respectively, 
16, 16 and 2 32 values (the integer data type is assumed to be comprised of a 32 
bit word). In the OpenVera language, d and c2 represent constraint blocks, with 
each block containing a constraint expression (or constraint). As can be seen, 
the constraint expression of block c1 is a declarative statement regarding a 

1 5 relationship that must be maintained over the variables "a," "b," "c, " and the 
constant value of 2. The constraint expression of block c2 is a declarative 
statement regarding a relationship that must be maintained between the variable 
"c"and the constant value of zero. The constraint solving problem comprises 
finding values for "a," "b," and "c"that satisfies the declarative statements of 

20 blocks c1 and c2. Within an OpenVera program, since OpenVera is an 

object-oriented programming language, Example 1 is part of a class declaration 
from which instances are created. The constraint solving process can be 
invoked by applying a randomize method to an instance. One solution to the 
constraints of Example 1 is: a = 1, b = 3, c = 2. 

25 The resulting precision and sign, from expression evaluation, play an 

important role in solving a set of constraints. Different precision and sign 
semantics, for expression evaluation, can lead to different solution spaces for the 
same set of constraints. One approach, for example, is to use the IEEE Verilog 
Language model of precision and sign semantics in expression evaluation. 

30 
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2. Constraint Repres ntation 

From an input set of constraints to be solved, a high-level representation, 
referred to herein as the "constraint set representation," is determined. The 
constraint set representation utilized by the present invention is a word-level 

5 network in which each operator, represented by a node, can propagate values 
that are not restricted to being just one or zero. The word-level nature of the 
networks addressed by the present invention permits it to more fully and 
efficiently explore the search space of a particular network than in prior 
approaches that focus upon single-bit-level networks. 

10 The word-level networks addressed by the present invention can be in the 

form of a directed acyclic graph (DAG), with each high-level operator and 
operand (both constants and variables) of a constraint represented as a node. 

Solving a set of constraints, as represented in the constraint set 
representation of the present invention, is essentially a word-level Satisfiability 

15 (SAT) problem. 

The Boolean satisfiability problem for prepositional formulas in conjunctive 
normal form can be defined as follows. A Boolean variable x, is a variable that 
takes the value true or false (represented as 1 or 0, respectively). We call the 
value assignment of one variable a literal. A clause is a disjunction of literals, 

20 e.g., (x l +x^+x 3 ). Given a set of clauses d, C 2 ,..., Cm and variables x 1t x 2 , 

x n , the satisfiability problem is to determine if the formula C 1 0 C 2 0 ... 0 C m is 
satisfiable, i.e., to determine whether an assignment of values to the variables 
exists so that the above formula is true. In the context of constraints solving, we 
extend this traditional notion of a SAT problem, such that the variables x h x 2 , 

25 x n can take ranges of values, instead of just 0 or 1, and each clause can be any 
constraint expression as defined above. 

Each constraint is independently modeled and all active constraints are 
solved for simultaneously. If the input constraint set contains more than one 
constraint, the DAG models of each constraint are conjoined using a root-level 

30 Boolean AND node. If the input constraint set comprises only one constraint, the 
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root level node, of the constraint set representation, may not be an AND node. 
Regardless of the type of the root-level node, it has to be justified. For the 
present invention, justification refers to assigning values to the leaf-level nodes 
of the DAG, associated with the root-level node, such that a logic 1 value is 
5 produced on the root-level node. The justification is accomplished through the 
assignment of an appropriate value to all the random variables appearing in 
currently active constraints of the input constraint set. Typically, the present 
invention solves all the constraints simultaneously, as opposed to solving them in 
a pre-determined order. However, the present invention embraces an input 

10 constraint set that specifies an order of evaluation, either explicitly or implicitly. 
In general, the term "justification" is used to refer to the process of 
determining legal values, without any uncertainty. When an input constraint set 
problem is satisfied by determining legal values to all random variables, all nodes 
in the constraint set representation are justified. The term "justified" is also 

15 defined below as it applies to Boolean nodes, with such nodes being called 
"justified Boolean nodes" or "unjustified Boolean nodes." 

There is a node in the constraint set representation for each of the 
following: i) a leaf-level node for each operand to a constraint, including input 
variables and constants (variables that participate in multiple constraints have 

20 multiple fanouts in the constraint set representation); ii) a root-level node for the 
output (which is an AND node in the case of multiple constraints); and iii) a node 
for each operator of a constraint, located between the leaf nodes and the 
root-level node. 

Each node of a constraint set representation is assigned a range of 
25 permissible values, indicated by a data structure referred to herein as a "range" 
(referred to in the pseudo-code herein as a "raceRange" object). A range is 
comprised of a set of one or more "intervals." An interval is a set of contiguous, 
monotonically increasing, integer values, defined (inclusively) by a low value and 
a high value. The intervals of a range are typically non-overlapping. A range 
30 may have more than one interval when they are needed to describe "gaps" in the 
set of values the range represents. The low and high values that define an 
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interval are typically of the same data type. The data type, for the low value and 
the high value, determines the desired bit width of the interval and whether it is a 
signed value. The present invention is designed to include capacity for very 
large bit widths, e.g., widths of up to 2 32 - 1 bits. Note that for purposes of 
5 illustration, ranges that contain only one interval may be depicted herein as a 
single set directly containing values, rather than as a set containing a single 
interval set. 

For each operator of the HVL (in which the input constraint set to be 
solved is written), algorithms for implication (such implication process addressed 
10 in detail below) using the above-defined range data structure are implemented. 
Some advantages of the range data representation are as follows. 
It is suitable for set operations, like union and intersection. As will be 
discussed below, such set operations are often useful in the implication process. 
Another advantage of the range representation is that it has no notion of 
15 an unknown, or "x," value. This simplifies the implication process because the 
same value representation is used for all the high-level operators, e.g., no 
distinction is made between datapath or control operators. 

For some constraint set representations involving certain types of 
operators, were the implication process to be pursued completely, some of the 
20 ranges could result in containing an excessive number of intervals. Such 
excessive number of intervals is due to the absence of an "x" value that can 
compactly express certain repetitive "gaps" in the range associated with a node 
of the constraint set representation. An approach of the present invention, for 
reducing the number of intervals needed to represent such repetitive gaps, is to 
25 produce an over-approximated range (i.e., a range that may contain values that 
cannot be part of a solution to the input constraint set). While an 
over-approximated range is a potential problem, in terms of increasing the 
amount of searching that the present invention must do in order to find a 
solution, such increased search possibilities are managed by heuristic 
30 techniques (such as iterative relaxation), and efficient backtracking (with such 
techniques as interval splitting), described below. 
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Yet another desirable property of the constraint set representation is that 
its size is linear in the size of the input constraint set to be solved. The constraint 
set representation is illustrated below. Consider the following set of input 
constraints, labeled Example 3, for which the resultant constraint set 
5 representation, along with initial values of the ranges, is shown in Figure 2: 
Example 3: 
rand bit [3 : 0] a, b; 
constraint d { 
a + b == 10; 
10 a - b == 6; 

} 

Example 3 (written in OpenVera), declares two random variables "a" and 
"b," each of which is four bits in width. The constraint block c1 contains two 
constraints, both of which must be satisfied. 

15 For Example 3, the two constants, 70, and 6, are interpreted as 32-bit 

signed numbers. The results of the adder and the subtractor are initially 
unsigned and unbounded in precision due to the type of their operands. The 
results of the adder and subtractor are converted into 32-bit unsigned numbers 
using the Precision without wrap (Pr) operators on the outputs of the adder and 

20 subtractor. IEEE Verilog HDL interprets mixed signs on the equality operator 
(e.g., the 32-bit signed constants and 32-bit unsigned results of the adder and 
subtractor) as unsigned. This is modeled using the cast unsigned {CU) operator 
on the output of each constant node, that converts the 32-bit signed number of 
each constant into a 32-bit unsigned number. 

25 As part of the model building process in the present invention, the primary 

input and primary output nodes of the constraint set representation are also 
initialized with value ranges. For example, the primary input node, a, is initialized 
with a range {0:15}. Similarly the output node is initialized with a range {1:1}, to 
model the constraint satisfiability problem. 

30 
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3.1 Overview 

A core sub-system of the present invention is a fast implication engine. In 
5 general, the implication engine explores implications: the extent to which a range 
at a node of the constraint set representation can be further limited as a 
deductive consequence of range values at other nodes of the constraint set 
representation. Towards this end, the implication engine manages such 
operations as node evaluation, scheduling and the extent to which implications 

10 are exhaustively explored. As part of the implication process, as performed by 
the implication engine, when a node evaluates to a new range as a result of an 
implication, the new range is intersected with the old range of the node. This 
ensures that results of an implication cannot reduce what is known about a 
range, since the range of values encompassed can either remain constant (if the 

1 5 latest implication adds no information) or decrease (if progress is made by the 
implication) in size as the implication process proceeds. If an intersection results 
in a range that is the empty set, an inconsistent state has been reached (also 
referred to as a conflict). 

An overview of the basic constraints-solving process, that uses the 

20 implication engine, is shown in Figure 3. The implication engine is referred to, in 
Figure 3 and in the below description, as an "implication process." 

The constraints solving process begins by performing an implication 
process (see step 302), based upon the initial state of the constraint set 
representation. The initial state of the constraint set representation comprises 

25 the following: the initial ranges of the constraint set representation and current 
values for the state variables. The initial ranges of the constraint set 
representation are determined by such factors as: the requirement of the 
root-level node being justified to {1 :1}, constant values specified as part of the 
constraints themselves, and the initial range values for random variables (that 

30 are primary inputs to the constraint set representation) as determined by their 
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precision and sign. Such implication process may include any or all of the 
following techniques: forward implication, backward implication, and case based 
learning. These implication techniques are described in more detail below. If a 
conflict results from the implication process ("yes" path of step 303 is taken), 
5 then a solution to the input constraint set does not exist and a value of FAILURE 
(see step 304) is returned. 

If the implication process does not end in failure, however, then all the 
random variables (rv's) of the constraint set representation that are not currently 
limited to a single value (referred to herein as an "available" rv), need to be 

10 identified (see step 305) such that, from among such available rv's, a current 
decision variable (dv) can be selected. Note that if there are no available rv's, 
then all the rv's have been limited to a single value and a solution to the input 
constraint set has been found. The finding of a solution to the input constraint 
set is indicated in Figure 3 by the procedure returning SUCCESS (see step 306), 

15 or similar suitable value indicating the same. The selection of a current dv (see 
step 308), from among the available rv's, can be accomplished according to a 
variety of different algorithms. A first approach is to select the current dv at 
random. A second approach is to compute a cost function, for each available rv, 
that is a metric of its desirability as a dv. 

20 Once a current dv has been selected, the next step is to limit the range of 

the current dv to encompass a single value (see step 309). Such range limitation 
of the dv may be performed gradually, using such techniques as iterative 
relaxation. Iterative relaxation is presented in more detail below. 

Once a value has been selected for the current dv, implications are 

25 performed on the constraint set representation (see step 307). This may include 
any or all of the following techniques: forward implication, backward implication, 
and case based learning. 

If no conflict results from the implication process (the "no" path of step 310 
is taken), then the procedure continues with picking the next current dv (at step 

30 305). 
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However, if a conflict does result from the implication process (the "yes" 
path of step 310 is taken), the procedure will remove the value causing the 
conflict from the range of the current dv, by splitting the previous range value of 
the dv and doing an implication process to gain any implications resulting from 
5 the additional range splitting (see step 311). A range is considered split if it has 
more than one interval. For example, consider a range that has a single interval 
{0:15}. By removing the value {7:7} from this range, we get a split range { {0:6}, 
{8:15} }. The original range that had only one interval is now considered split 
because it has 2 intervals. Also, in case of a conflict from the implication 

10 process, the procedure will backtrack by limiting the current dv to another single 
value of its range and performing the implication process once again. If, 
however, all the single values for the current dv have been exhausted (see step 
312), the procedure will next try backtracking to the previously current dv (see 
steps 313 and 314) and try to limit that previously current dv to another single 

15 value of its range than had previously been settled upon (see step 309). If, 
however, there is no previously current dv to backtrack to ("no" path of step 313 
is taken), then the procedure ends in FAILURE (see step 315). 

Further details of the basic constraint-solving process are presented 

below. 

20 

3.2 Implication Process 

For each operator of the constraint specification language, algorithms are 

implemented to perform any or all of the following across its constraint 
representation node: forward and backward implications. For certain operators 

25 like Boolean nodes, algorithms are also implemented to perform case-based 
learning which, in general, lead to more implications. While the basic framework 
of the implication process is comprised of the forward and backward techniques, 
described below, heuristic approaches, such as case-based learning (also 
discussed below), can also make important contributions to limiting the search 

30 space. 
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3.2.1 Forward Implication 

In general, forward implication across an operator node is the process of 
determining a value range for that node's output using the value ranges of all its 
5 input nodes and the semantic functionality of that operator. Such forward 
implication can be done using unbounded precision. For example, consider an 
adder with two 4-bit unsigned inputs that have value ranges {0:15} and {5:10}. 
The output of this adder is evaluated and represented in 5-bit precision with the 
value range {5:25}. Note that for many operators (for example Boolean, relational 

10 and unary reduction operators), the output node value range can be either {0:0}, 
{1:1}, or {0:1}. For signed or unsigned semantics, these ranges can be 
represented in 2 bits of storage. For example, if we are forward evaluating a 
less-than comparator, where the two input ranges are {{0:3}, {5:6}} and {9:12}, 
respectively, the result would be {1:1}. On the other hand if the second range 

1 5 value was {6:12} instead of {9:12}, the result would be {0:1}. 



3.2.2 Backward Implication 

In general, backward implication, to an input of an operator node, is the 
process of determining a range on that input using the ranges of other inputs of 

20 that operator node, the range of the output of that node and the semantic 

functionality of the operator. To illustrate a simple case of backward implication, 
consider a comparator node "c"(an operator node is identified herein, for 
purposes of illustration, with its output signal), that evaluates a < b, where a and 
b are 4-bit unsigned inputs to the comparator. Assume that c = {1:1}, a = {0:15}, 

25 and b = {0:15}. A backward evaluation to node "a" implies that a = {0:14}. 
Similarly, a backward evaluation to node "b" implies that b = {1:15}. 
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3.2.3 Pseudo-Code 

Section 4.1 contains an example pseudo-code embodiment for top-level 
functionality of the implication engine as discussed in Overview Section 3.1. 
Section 4.2 contains an example pseudo-code embodiment for the general 
5 forward implication process of Section 3.2.1 , while Section 4.3 contains an 

example pseudo-code embodiment for the general backward implication process 
of Section 3.2.2. Section 4.7 contains example pseudo-code that customizes the 
general pseudo-code of Sections 4.2 and 4.3 to specific operators. 

The term "race" is used as a root word for many of the variable and 

10 function names of the pseudo-code contained herein. This term is used to refer 
generally to the present invention, and is an acronym of the following phrase 
"RACE (Random ATPG for solving Constraint Expressions)." The RACE 
acronym reflects a view of the present invention as based upon adapting ATPG 
(Automatic Test Pattern Generation) techniques to the finding of randomly 

1 5 distributed solutions to constraint expressions. 

Scheduling optimizations, that may be used in conjunction with the 
pseudo-code, include the following. Backward implication may only be 
performed on some inputs of a node. For example, consider a node with 2 
inputs, called "a" and "b," and an output called "c." If input "a" gets a new value 

20 that causes a forward implication where output "c" obtains a new value, then 
output "c" is only backward implicated to input "b." Input "a" is skipped for 
backward implication because it would not reveal new information. 

The pseudo-code of Section 4.1 operates as follows. Section 4.1 defines 
a procedure named "ImplyValueslnCircuitFe," that has parameters "impVals," 

25 and "nodeslmplied." The "Fe" of ImplyValueslnCircuitFe stands for "front end," 
and ImplyValueslnCircuitFe is an embodiment of an overall implication process 
that proceeds until the possible implications of a given constraint set 
representation has been converged upon. The parameter "impVals" is a list of 
pairs of a node and its range. The impVals list represents those nodes that the 

30 implication process is directed to use as the basis of its implications. The 
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parameter "nodeslmplied" is a list of nodes whose ranges were changed as a 
result of the implication process of ImplyValueslnCircuitFe. 

When ImplyValueslnCircuitFe is used to perform the implication process 
(labeled 302) of Figure 3 that immediately follows START, the value of impVals 
5 can be each leaf node, and the root node, of the constraint set representation. 

When ImplyValueslnCircuitFe is used to perform the implication process 
(labeled 307) of Figure 3 that follows the limitation of the current dv to a single 
value, the value of impVals can be a single pair of the current dv node and its 
selected range value. 

10 ImplyValueslnCircuitFe calls the functions Fowardlmply (Section 4.2) and 

Backwardlmply (Section 4.3). 

The pseudo-code of Section 4.2 operates as follows. Section 4.2 defines 
a procedure named "Fowardlmply," that has parameters "forwardQueues," 
"backwardQueues," and "nodeslmplied." The parameter "forwardQueues" 

15 contains levelized queues of nodes in the constraint set representation that are 
to be subject to forward implication. Similarly, the parameter "backwardQueues" 
contains levelized queues of nodes in the constraint set representation that are 
to be subject to backward implication. Note that backwardQueues, with respect 
to Forwardlmply, is acting as an output parameter that is input to Backwardlmply 

20 for backward implication. As with ImplyValueslnCircuitFe, the parameter 

"nodeslmplied" is a list of nodes whose ranges were changed as a result of the 
implication process of Forwardlmply. 

Levels, for the purpose of the levelized queues, can be defined as follows 
for the constraint set representation. All the leaf nodes are assigned an initial 

25 level, such as zero. In the example of Figure 2, from left to right, the following 
leaf nodes are assigned value zero: 10, "a," "b," and 6. The parent nodes of 
each leaf node is identified. In the example of Figure 2, from left to right, these 
are: CU, +, -, and CU. Each parent of a leaf node is assigned a level that is one 
greater than the greatest level of any of its children. In the example of Figure 2, 

30 all of the parent nodes are assigned the level of one. The levelization process 
then finds the parents of all the level one nodes. In the example of Figure 2, 
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from left to right, these are: ==, Pr, Pr, and ==. Each parent of a level one node 

is assigned a level one greater than the greatest level of any of its children, so 

long as all of its children have already been assigned a level. In the case of the 

two "==" nodes, each has a Pr node child that has not already been assigned a 

5 level and so these two nodes are not assigned a level. The two Pr nodes 

themselves, however, are each assigned a level of two. The levelization process 

continues in a likewise manner, where the next step is finding the parents of the 

two Pr nodes of level two. The levelization process continues to move up the 

constraint set representation until the root node has been assigned a level. For 

10 the example of Figure 2, the end result of the levelization process is as follows: 

Level 0 nodes: 10, a, b, 6 
Level 1 nodes: CU, +, -, CU 
Level 2 nodes: Pr, Pr 
Level 3 nodes: ==, == 
1 5 Level 4 nodes: && 

The pseudo-code of Section 4.3 operates as follows. Section 4.3 defines 

a procedure named "Backwardlmply," that has parameters "forwardQueues," 

"backwardQueues," and "nodeslmplied." The parameter "backwardQueues" 

contains levelized queues of nodes in the constraint set representation that are 

20 to be subject to backward implication. Similarly, the parameter "forwardQueues" 
contains levelized queues of nodes in the constraint set representation that are 
to be subject to forward implication. Note that forwardQueues, with respect to 
Backwardlmply, is acting as an output parameter that is input to Forwardlmply 
for forward implication. As with Forwardlmply, the parameter "nodeslmplied" is a 

25 list of nodes whose ranges were changed as a result of the implication process 
of Backwardlmply. 

The pseudo-code of Section 4.7 operates as follows. The pseudo-code of 
Section 4.7 is utilized, on an operator-specific basis, by Forwardlmply and 
Backwardlmply. Specifically, the pseudo-code of Section 4.7 is invoked in 
30 Forwardlmply by the line labeled 2.a that reads as follows: 
newValue = forward evaluate node 
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The pseudo-code of Section 4.7 is invoked in Backwardlmply by the line 
labeled 2.a.i.1 that reads as follows: 

newValue = backward evaluate to input_node 
The pseudo-code of Section 4.7 is written on an interval basis, while the 
5 lines 2.a of Forwardlmply and 2.a.i.1 of Backwardlmply are passing whole 
ranges of the node to be implied. Therefore, between the calls of lines 2.a of 
Forwardlmply and 2.a.i.1 of Backwardlmply, and the interval-basis pseudo-code 
of Section 4.7, is additional code that generates cross-product combinations of 
intervals for the node to be implied. Each such cross-product combination is 
1 0 processed by the appropriate forward or backward implication pseudo-code of 
Section 4.7, and the results of all the cross-products, are combined to produce 
the final result for lines 2.a of Forwardlmply and 2.a.i.1 of Backwardlmply. 

For example, consider an AND node, with inputs "a" and "b," that is to be 
forward evaluated by line 2.a of Forwardlmply. If the range of input "a" has two 
1 5 intervals, while the range for input "b" has three intervals, the number of 

cross-product combinations of intervals, each of which is to be processed by the 
"&&" operator pseudo-code of Section 4.7.3.1 , is two times three or six. 

3.2.4 Case-Based Learning 

20 Case-based learning explores implications using case-analysis on 

unjustified Boolean nodes. In general, the implication results on a variable node, 
for each case analyzed, are accumulated and the union represents the legal 
possible values for that variable. 

The case-based learning technique described below is generally 

25 applicable to the annotation of word-level networks and is not limited to 

word-level networks as used for constraint set solving. Once the case-based 
learning technique has been presented below with respect to constraint set 
solving, other example applications of the technique are discussed. 
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3.2.4.1 Unjustified Boolean Nodes 

The Boolean nodes considered for case-based analysis are AND (&&) 
and OR (||). Without loss of generality, the description below assumes that the 
Boolean nodes to be analyzed have two inputs. In the absence of known or 
5 assumed constraints, the possible output values that a Boolean node can have 
are expressed by the intervals: {0:0}, {1:1} and {0:1}. The values that the inputs 
of a Boolean node can have depend on the following factors: i) the precision and 
sign of the Boolean node's input nodes, which determine the maximum range 
that the node can have, and ii) constraints upon the Boolean node's input nodes. 

10 The output of a Boolean node is said to have a controlling value if its 

range is {1:1} for an OR node and {0:0} for an AND node. The range of an input 
of an OR node is said to only contain values classified as controlling if its range 
only contains values that do not include {0:0}. The range of an input of an AND 
node is said to only contain values classified as controlling if its range only 

1 5 contains {0:0}. The range of an input of an AND node is said to only contain 
values classified as non-controlling if its range only contains values that do not 
include {0:0}. The range of an input of an OR node is said to only contain values 
classified as non-controlling if its range only contains {0:0}. 

In the absence of known constraints for its output, if both inputs of a 

20 Boolean node have ranges that contain both controlling and non-controlling 

values, then forward implication applied to such a Boolean node will result in the 
{0:1} range on its output. 

An unjustified Boolean node (or UBN) is a Boolean node whose output 
range has a controlling value ({1:1} for OR node and {0:0} for AND node) and the 

25 range of each input has both controlling and non-controlling values. A Boolean 
node that does not satisfy this definition of unjustified is classified as a justified 
Boolean node. 

For an unjustified Boolean node, it is known that the output of the node 
has been put to a controlling value by at least one of the inputs, but it is not 
30 known which input or inputs will cause such controlling output value. Therefore, 
unjustified Boolean nodes can be subjected to case analysis, in which, one-by- 
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one, each of the Boolean node's inputs is assumed to have a controlling value. 
The implications, resulting from such controlling value assumption, are explored. 

As an example of how an OR node can be made to be justified or 
unjustified, consider an OR node whose output range is {1:1} and whose two 
5 inputs, "a"and "b/'have the ranges of {0:15} and {0:31}, respectively. This is an 
example of an OR node where the ranges of both inputs contain both controlling 
and non-controlling values. This OR node is unjustified. 

If the ranges for "a" and "6" are changed to, respectively, {12:15} and 
{0:7}, however, an example is produced in which only one of the ranges contains 
10 both controlling and non-controlling values (the range {0:7}), while the other 
range contains only controlling values (the range {12:15}). In this example, the 
OR node is no longer unjustified because forward implication on the node will 
result in the {1:1} range on its output that is consistent with the pre-existing range 
of the output. 

15 If the ranges of "a" and "6" are changed to {0:0} and {0:7}, respectively, an 

example is produced in which only one of the ranges contains both controlling 
and non-controlling values (the range {0:7}), while the other range contains only 
non-controlling values (the range {0:0}). In this example, the OR node is also no 
longer unjustified for the following reason. A backward implication to input u b" 

20 will result in range {1 :7} on input "b" A subsequent forward implication of the OR 
node, with the new ranges for "a" and "b," results in the range {1:1} on the output 
that is consistent with the current range of the output. 

3.2.4.2 Overview of case-based learning 

25 Section 4.4 presents a pseudo-code description of the case-based 

learning technique. With respect to the overall constraints-solving process of 
Figure 3, the pseudo-code of Section 4.4 is intended for use in the implication 
process (see step 302) that immediately follows START. Within the implication 
process, the pseudo-code of Section 4.4 is intended for use after the forward 

30 and backward implications (as illustrated by the pseudo-code of Sections 4.2 and 
4.3) have been performed. The pseudo-code of Section 4.4 can also be used, 
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with the necessary changes, at other points within the overall constraints-solving 
process of Figure 3. For example, the pseudo-code can be used in the 
implication process that follows the step that limits the range of the current dv to 
a single value (see step 307). 
5 The main case-based learning procedure of Section 4.4 is 

PerformLearninglnCircuitFe, that takes as a parameter "raceCircuit" that is set to 
the constraint set representation to be processed. Figure 13A graphically 
depicts an overview of PerformLearninglnCircuitFe. PerformLearninglnCircuitFe 
iterates over each unjustified Boolean node (UBN) of the raceCircuit, referred to 

10 herein as the current UBN, and invokes the procedure PerformLearninglnCircuit 
(see step 1 .b of PerformLearninglnCircuitFe) upon the current UBN. If the 
case-based learning succeeded in yielding additional information ("retVal" is 
tested TRUE in step 1.c), then an implication process is performed using 
ImplyValueslnCircuitFe (see step l.c.i that invokes ImplyValueslnCircuitFe). 

1 5 The case-based learning technique of PerformLearninglnCircuit is 

described below in conjunction with the following example constraint set (written 
in OpenVera), labeled Example 6, whose constraint set representation is shown 
in Figure 4: 

Example 6: 
20 rand bit[31 : 0] a; 

constraint c1 { 

a == 10 || a == 15 || a == 20; 
} 

In Example 6, "a" is declared to be a random variable with a width of 32 
25 bits. Example 6 has a single constraint block, called c1 , containing a single 
constraint. 

Variable "a" of Example 6 begins with a range of {0: 2 32 - 1}. Without 
case-based analysis, the range of "a"cannot be reduced from its initials 32 values 
by the basic techniques of forward and backward implication as performed by 
30 ImplyValueslnCircuitFe. By using case-based analysis, it can be determined that 
node "a" can only take values 10, 15 or 20. 
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The OR node (labeled 401) with output "v" (or node "v") is an unjustified 
node. If the inputs to node "v" are assumed, from left to right, to each have a 
controlling value, then the OR node (labeled 402) with output "x" (or node "x") is 
first assumed to be an unjustified node. Recursively, case-based analysis is 
5 performed on node "x." If the inputs to node "x" are assumed, from left to right, 
to each have a controlling value, then the output of the "==" node, for the "==" 
operator that has variable "a" and 10 as inputs, is the first node to have its output 
assumed to be one. Such an assumption implies that the variable "a" is equal to 
ten. Stepping through all four combinations, of assuming a one on the inputs of 
10 either node "v" or node "x," it is determined that node "a" can only take values 10, 
15 or 20. 

The procedure PerformLearninglnCircuit makes a distinction between 
what is called "recursive learning" and what is referred to as "global learning." 
When the inputs to an unjustified Boolean node are each assumed to 

15 have a controlling value, and when such assumption leads to the input also 
being an unjustified Boolean node, then recursive learning is said to have 
occurred. In the above example of Figure 4, recursive learning occurred when 
assuming that the node "x" input to node V is at a controlling value recursively 
implied that node "x" is also unjustified. 

20 Global learning occurs when, as a result of the input constraint set, at 

least two nodes are unjustified. In the example of Figure 4, only node "v" is 
initially unjustified. If we assume, however, an alternative constraint set 
representation in which there is another initial unjustified node "w," and that both 
node "v" and node "w" are explored for combinations of having an input with a 

25 controlling value, then global learning is said to be performed. To limit 

computational complexity of the global learning process, embodiments of the 
invention can use a heuristic to perform such global learning only on a subset of 
the remaining unjustified nodes that are within a small pre-defined number of 
levels of logic within the level of the original unjustified node on which recursive 

30 learning was invoked. 
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In addition to the above approaches to recursive and global learning, 
embodiments of the invention can use several additional heuristics to bound 
computation. These heuristics can track, from previous UBNs that were 
analyzed for recursive or global learning, such quantities as: the number of 
5 learned implications (i.e., implications that narrowed the set of possible solutions 
to the constraints), and the total number of implications that were performed to 
obtain the learned implications. Such quantities can be tracked on a per-UBN 
basis, or running totals can be kept. A percentage of learned implications can be 
determined from using both a number of learned implications value and a total 

10 number of implications performed value. All of these quantities (i.e., learned 
implications, total implications and percentage of learned implications) can be 
subject to a threshold test, whereby a currently analyzed UBN can be compared 
to previously analyzed UBNs. Using this approach, the recursive or global 
learning technique is adaptive in its ability to terminate if it determines the 

1 5 learning is not effective enough for a particular circuit. 

An overview of PerformLearninglnCircuit, as it can operate once called by 
PerformLearninglnCircuitFe of Figure 13A, is depicted in Figure 13B. 

PerformLearninglnCircuit iterates over each input to the current UBN 
passed to it by PerformLearninglnCircuitFe, each such input referred to as the 

20 current UBN input. For each current UBN input, it is set to a controlling value 
and then RecursivelmplyDecisionValue is called. As can be seen in Figure 13B, 
RecursivelmplyDecisionValue performs, from left to right, three sequential child 
invocations, which shall be referred to herein as phases. The second and third 
phases each comprise an invocation of RecursiveLearnAndlmply followed by a 

25 recursive invocation of PerformLearninglnCircuit. The recursive invocation of 
PerformLearninglnCircuit for the second phase, and all child processes invoked 
as a result of it, complete before the third phase begins. 

In the first phase, RecursivelmplyDecisionValue calls 
ImplyValueslnCircuitFe, an implication process that determines the implications, 

30 if any, of setting the current UBN input to a controlling value. 
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In the second phase, RecursivelmplyDecisionValue creates a list of the 
UBN's in the constraint set representation (the list referred to as unjustNodes), 
that excludes the current UBN but includes UBN's resulting from an invocation of 
PerformLearninglnCircuit setting a current UBN input to a controlling value. 
5 RecursivelmplyDecisionValue then calls RecursiveLearnAndlmply with 

unjustNodes as a parameter. RecursiveLearnAndlmply iterates over each UBN 
of unjustNodes, recursively invoking PerformLearninglnCircuit on each such 
node. Recursive learning occurs where a recursive invocation of 
PerformLearninglnCircuit is applied to a node that became a UBN as a result of 

10 a controlling value being applied to a current UBN input by a prior invocation of 
PerformLearninglnCircuit. 

The third phase for RecursivelmplyDecisionValue is similar to the second 
phase. As in the second phase, an unjustNodes list is created. However, the 
unjustNodes list of the third phase includes all UBN's of the constraint set 

1 5 representation. Thus, the unjustNodes list of the third phase includes UBN's, 
other than the current UBN, that result from the input constraint set itself. 
RecursivelmplyDecisionValue then calls RecursiveLearnAndlmply with 
unjustNodes as a parameter. RecursiveLearnAndlmply iterates over each UBN 
of unjustNodes, recursively invoking PerformLearninglnCircuit on each such 

20 node. Global learning occurs where the recursive invocation of 

PerformLearninglnCircuit is applied to a node that is a UBN as a result of the 
input constraint set, independent of dynamic assumptions that have been made 
by invocations of PerformLearninglnCircuit. 

25 3.2.4.3 Detailed discussion of pseudo-code 
3.2.4.3.1 PerformLearninglnCircuit 

Once PerformLearninglnCircuitFe has focused upon the current UBN, 
PerformLearninglnCircuit attempts to accomplish case-based learning from it. 
30 PerformLearninglnCircuit iterates over each input to the current UBN, 

referred to as the current UBN input (see pseudo-code line labeled 2). 
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A controlling value, called "sel_value," is generated for the current UBN 
input (see pseudo-code line labeled 2.a). 

RecursivelmplyDecisionValue is then invoked to find the implications 
resulting from setting the current UBN input to sel_value (see pseudo-code line 
labeled 2.b). For the example of Figure 4, if the "y" input is the current UBN 
input, then the setting of "y" to a value greater than zero will cause 
RecursivelmplyDecisionValue to learn that the variable "a" must then have a 
range {20:20} and this result is returned by RecursivelmplyDecisionValue in its 
nodeslmplied parameter. 

The result of performing RecursivelmplyDecisionValue is tested by the 
pseudo-code line labeled 2.c. 

If RecursivelmplyDecisionValue failed, this indicates that a conflict 
resulted from the setting of the current UBN input to a controlling value. The 
failure of RecursivelmplyDecisionValue is indicated by "retVal" testing FALSE, 
causing the "else" of the pseudo-code line labeled 2.d is performed. If a conflict 
resulted, sel_value is excluded from the range of the current UBN input so that it 
will not be tried again. The controlling value itself is a range and can include all 
individual controlling values. For example, a controlling value for an OR gate is 
the range {1:15}, and if the implications of this value failed, it means that none of 
the values in range {1:15} are possible. 

If RecursivelmplyDecisionValue succeeded, then the following is 
performed. First, a test is performed to determine whether the current UBN input 
is the first input of the current UBN to be processed by this particular invocation 
of PerformLearninglnCircuit (see pseudo-code line labeled 2.c.i). If the result of 
this test is TRUE, then the implications just learned from invoking 
RecursivelmplyDecisionValue are always kept (see pseudo-code line labeled 
2.c.i.1 ). If the current UBN input is not the first input of the current UBN to be 
processed, the implications just learned are unioned with the implications 
learned from the setting of the earlier-considered inputs of the current UBN to a 
controlling value (see "for" loop of pseudo-code labeled 2.c.ii.1). 
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Regardless of whether RecursivelmplyDecisionValue succeeded, once its 
results have been processed, the state of the constraint set representation (often 
referred to as "the circuit" in the pseudo-code) is restored to the state it was in 
before the pseudo-code step labeled 2.b such that the next input of the current 
5 UBN can be considered as the current UBN input (see pseudo-code line labeled 
2.e). 

Once all the inputs of the current UBN have been considered, the variable 
"failCount" is tested (see pseudo-code line labeled 3). For each input of the 
current UBN for which RecursivelmplyDecisionValue failed, failcount was 
10 incremented. In this pseudo-code, it is assumed that all UBNs have only two 
inputs. 

If failCount equals two, it is known that setting either input of the current 
UBN to a controlling value resulted in a conflict. Thus failCount equaling two 
indicates a serious problem performing any case-based learning on the 

15 constraint set representation. In this case, any implications learned thus far from 
case-based learning are deleted (by the pseudo-code line labeled 4.a) and 
PerformLearninglnCircuit returns a FALSE value (by the pseudo-code line 
labeled 4.b) to PerformLearninglnCircuitFe. PerformLearninglnCircuitFe 
receiving a FALSE value causes it to do no implication process upon the 

20 constraint set representation based upon case-based learning and 

PerformLearninglnCircuitFe simply returns a failure value of FALSE. In essence, 
this represents a conflicting set of constraints that cannot all be satisfied 
simultaneously. 

If failCount is less than two, then any case-based learning accomplished 
25 from the current UBN is accumulated in the learnedlmps table (by the pseudo- 
code line labeled 3.a). Also, PerformLearninglnCircuit returns a TRUE value (by 
the pseudo-code line labeled 3.b) to PerformLearninglnCircuitFe. 
PerformLearninglnCircuitFe receiving a TRUE value causes it to do an 
implication process upon the constraint set representation based upon 
30 case-based learning of the current UBN (i.e., ImplyValueslnCircuitFe is invoked 
by pseudo-code line labeled 1 .c.i. 
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3.2.4.3.2 RecursivelmplyDecisionValue 

RecursivelmplyDecisionValue's parameters include a constraint set 
5 representation (also called a raceCircuit or circuit), an input_node that has been 
set to sel_value and a nodeslmplied table that is to be populated. Discussion of 
RecursivelmplyDecisionValue is illustrated in this section by discussing it in 
conjunction with the example of Figure 4, with the assumption that the input "x" 
has been set to a controlling value (e.g., {1:1}). 
10 The implications learned by the present invocation of 

RecursivelmplyDecisionValue are kept in the impVals table. 
RecursivelmplyDecisionValue begins (in the pseudo-code line labeled 1) by 
storing the fact of "x" being set to a controlling value in the impVals table. 

The implication engine ImplyValueslnCircuitFe is then invoked (by the 
1 5 pseudo-code line labeled 2), but the result of simply setting "x" to a controlling 
value does not yield any further results (for the example of Figure 4) through 
forward or backward implication. 

If the recursive learning depth tested for by RecursivelmplyDecisionValue 
(by the pseudo-code line labeled 3) is not exceeded, then the following case- 
20 based learning is accomplished. 

A list of nodes, called unjustNodes, is created (by the pseudo-code line 
labeled 3.a) that lists nodes (like "x") that have been set to a controlling value by 
the case-based learning process. 

While a list of nodes, such as unjustNodes, can be recursed upon 
25 according to variety of strategies, one approach (performed by the pseudo-code 
line labeled 3.b) is to sort such nodes in reverse levelized order. Such a sorting 
means that UBNs closer to the root of the constraint set representation are 
earlier on the list. RecursiveLearnAndlmply is then invoked (by the pseudo-code 
line labeled 3.c) with the unjustNodes list passed as a parameter. 
30 RecursiveLearnAndlmply iterates over each UBN of unjustNodes (see 

pseudo-code line labeled 1) and recursively invokes PerformLearninglnCircuit 
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upon it (see pseudo-code line labeled 1 .b). In the case of node "x" being set to a 
controlling value, the invocation of PerformLearninglnCircuit by 
RecursiveLearnAndlmply means that "x" itself is then treated as a UBN, and 
explored by case-based analysis, in the same manner as which V is explored 
5 when PerformLearninglnCircuit is called by PerformLearninglnCircuitFe. Such 
recursive exploration of V is an example of recursive learning. 

Once the call to RecursiveLearnAndlmply by 
RecursivelmplyDecision Value has been completed, a fuller consideration of the 
constraint set representation's UBNs is performed (by the pseudo-code line 

10 labeled 3.d). In particular, a list of UBNs is compiled, referred to by the variable 
unjustNodes, that includes all UBNs of the constraint set representation. Thus, 
the second unjustNodes list of RecursivelmplyDecisionValue (compiled by the 
pseudo-code line labeled 3.d.i) includes all UBNs resulting from the input 
constraint set itself, without need to make additional assumptions regarding 

1 5 whether a node has a controlling value. As with the first unjustNodes list, the 
second unjustNodes list can also be sorted in reverse levelized order. Also as 
with the first unjustNodes list, it is passed as a parameter to 
RecursiveLearnAndlmply (in the pseudo-code line labeled 3.d.iii). 

Referring to the example of Figure 4, assume that there is an additional 

20 node "z," not shown in Figure 4, that like V is also a UBN as a result of the input 
constraint set. Consideration of another independently UBN node, such as "z," 
while exploring another UBN, such as "v," that is also unjustified independent of 
dynamic assumptions, is an example global learning. Note that while 
PerformLearninglnCircuitFe does iterate over every UBN, it will not, for example, 

25 iterate backwards to see whether subsequently considered UBN might effect the 
learning opportunities of earlier-considered UBNs. Such backward exploration is 
one advantage of the exploration of the second unjustNodes list. The global 
learning process is limited to within a certain neighborhood of the current UBN 
input by only adding to the second unjustNodes list those UBNs that are within a 

30 predefined number of levels from the current UBN input (see 

RecursivelmplyDecisionValue pseudo-code definition, line labeled 3.d.i). 
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3.2.4.4 Global Learning Example 

Another example of the implications that can be learned with the case- 
based technique is depicted using the following constraints (that happen to be 
5 written in the Vera language): 

rand bit[31:0]a, b; 
constraint cl { 
a in {0:2} 

(a == 0) => (b == 2) 
10 (a == 1) => (b == 3) 

(a == 2) => (b == 4) 

} 

Figures 10A and 1 1A show a corresponding constraint set representation 
for the above fragment. Figure 1 1 A depicts a constraint set representation for 
1 5 the constraint "a in {0:2}," while Figure 1 0A depicts a constraint set 

representation for the remaining constraints. The possible values for variables 
"a" and "b" begin as {0: 2 32 - 1}, as indicated in Figures 1 1 A and 1 0A by their 
lack of any limiting range. 

Application of the implication process, and specifically backward 
20 implication, to the constraint set representation of Figure 1 1A results in the 
annotated ranges of Figure 1 1B. As can be seen, node "a" has been limited to 
{0:2}, while each of the following nodes has been limited to {1:1}: "v," "w," "x." 
These implied values for "a", "v," "w" and "x" have been added to the constraint 
set representation of Figure 10B. At this point, however, without application of 
25 case-based learning, nothing more can be implied about the constraint set 
representation of Figure 10B. 

The unjustified nodes of Figure 10B, each of which is a candidate for 
case-based learning, are "v," "w" and "x." 

Case-based learning, without global learning, can be applied as follows to 
30 the unjustified node "v." Figure 10C depicts the implications resulting from 
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setting the "p" input to node "v" to a controlling value, while Figure 10F depicts 
the implications resulting from setting the "q" input to node V to a controlling 
value. Figure 10C limits "a" to {1 :2}, while Figure 10F limits "a" to {0:0}, with the 
union being the same {0:2} range for "a" that was known prior to the application 
5 of case-based learning. Similarly, Figure 10C does not limit "b" (i.e., it remains at 
its declared range of {0:2 32 -1}), while Figure 10F limits "b" to {2:2}, with the union 
being the same {0: 2 32 -1} range for "b" that was known prior to the application of 
case-based learning. 

Returning to Figure 10C, an example of global learning, that can be 
10 pursued, is as follows. In conjunction with setting "p" to a controlling value, the 
further effect of a controlling value on either of nodes "r" or "s," with respect to 
unjustified node "w," can be explored. 

Note that similar global learning cannot be pursued, with respect to the 
setting of "q" to a controlling value (as shown in Figure 10F), by exploring, in 
1 5 conjunction, the setting of controlling values on any of nodes "r," "s," "t," or "u." 
This is because the setting of "q" to a controlling value implies values for the 
inputs to the other two unjustified nodes "w" and "x." Setting "q" to a controlling 
values implies, with respect to "w," that node "s" is {0:0} while node "r" is {1:1}. 
Setting "q" to a controlling values implies, with respect to "x," that node "u" is 
20 {0:0} while node "t" is {1:1}. 

Figure 10D depicts that setting node T to a controlling value limits "a" to 
{2:2} and "b" to {4:4}. Figure 10E depicts that setting node "s" to a controlling 
value limits "a" to {1:1} and "b" to {3:3}. 

By using global learning, the result of setting "p" to a controlling value is 
25 no longer just "a" being {1 :2}, but is also the fact that "b" is {3:4}. Therefore, 
unioning the results of setting "p" and "q" to a controlling value yields "a" still 
being {0:2}, but "b" being {2:4}. 

3.2.4.5 Other Applications 

30 In general, as discussed above, the case-based learning technique 

described below is generally applicable to the annotation of word-level networks. 
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Other applications in which the processing of word-level network can be 
optimized as a result of such annotation include the following: hardware design 
synthesis, automatic test pattern generation (ATPG), and formal circuit analysis. 

A specific example of how the case-based analysis of Figure 4 can be 
5 used to perform more optimal hardware design synthesis is as follows. 

The example of Figure 4 can be considered as a network resulting from a 
high-level hardware specification, such as Verilog, that has been produced by a 
hardware translation program, such as HDL Compiler of Synopsys, Inc., 
Mountain View, USA. The network of Figure 4, however, is still relatively 
10 high-level and it may be desired to translate the word-level network of Figure 4 
into a bit-level network using a hardware translation program such as Design 
Compiler of Synopsys, Inc. 

While the variable "a" of a Verilog specification that produced Figure 4 
may been defined as having 32 bits, it has been determined, by case-based 
15 analysis upon the network of Figure 4, that variable "a" is only to be compared 
with the values 10, 15 and 20. Therefore, the hardware realization of "a," when 
translated into a bit-level network, need only have five bits. Thus, a much more 
efficient hardware realization, compared with providing for 32 bits, can be 
produced. 

20 An example application of global learning to ATPG is as follows. 

Specifically, global learning can be applied to gate-level (also referred to as 
bit-level) ATPG. Unlike simply using recursive learning, global learning permits 
consideration of several combinations of UBNs. Although the present invention 
has been described with respect to word-level ranges, with respect to global 

25 learning it can also be applied to gate-level designs. The additional implications 
learned with global learning can be used to generate test vectors and to prove 
certain faults as untestable. Global learning can be applied statically (as a pre- 
processor to ATPG) or dynamically (during ATPG). 
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3.3 Cost Function For Current Decision Variable Selection 

Embodiments of the invention pick from among the available primary-input 

random variables to select the current decision variable (dv). Even when user- 
defined variable priorities are supported by embodiments of the invention, there 
5 can still be multiple available variables at the same priority. In such a case, it 
may be preferable to determine a cost function to decide which variable to pick 
first for assignment. Characteristics utilized by the cost function can include the 
following: i) the input constraint set's structure, including inter-dependencies 
between the constraints, ii) the number of constraints each variable participates 

10 in, iii) types of operators the variable participates in, and iv) the range 

characteristics of each variable (as specified, for example, by the data structure 
of the range, such data structure referred to in the pseudo-code herein as a 
"raceRange" object). An additional characteristic that can be utilized, and one 
that is adaptive, is the backtracking history of each candidate decision variable. 

1 5 The cost function guides the constraints-solving process to postpone 

decisions on variables that are expected to be problematic. By assigning 
less-problematic variables first, the ranges for problematic variables can 
potentially shrink, thereby reducing their search-space. 

Section 4.5 presents a pseudo-code procedure to compute a cost 

20 function. After executing this procedure, a current decision variable is randomly 
chosen from the computed prunedList of variables. 

The pseudo-code of Section 4.5 operates as follows. Part 1 .a of Section 
4.5 determines, for each node that is a candidate for the current dv (or candidate 
dv), a metric. The metric is a product of the following three quantities. First, the 

25 fanout of the candidate dv. Second, the number of values in range of the 

candidate dv. Third, the amount of backtracking that needed to be done, when 
the candidate dv was selected as the current dv as part of finding other solutions 
to the input constraint set. 

Once the metric has been determined, Part 1.b of Section 4.5 stores 

30 pairs, of a candidate dv and its metric, in a list called "decList." 
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Part 2 of Section 4.5 puts the decList list of Part 1 .b in ascending order, 
based upon the metric. This is because the smaller the metric that better the 
candidate dv. 

Part 3 of Section 4.5 picks only a limited number of candidate dv's, for 
5 inclusion in prunedList, starting from the beginning of decList. A candidate dv is 
selected if either test 3.a.i or 3.a.ii is satisfied. Test 3.a.i causes the first 
candidate dv of decList to always be selected. Test 3.a.ii has two parts that must 
be satisfied: the metric for a candidate dv must be within a certain percentage of 
the metric for the last candidate dv chosen; and the total number of candidate 
10 dv's selected must not be above a certain pre-defined limit. 

3.4 Limiting Current DV To A Single Value: Iterative Relaxation 

Once a current dv has been picked, the next problem is to limit its range 

to a single value that can be part of a solution to the input constraint set. This 
can be accomplished by the following process, that is also depicted in Figure 14. 

15 From the range of the current dv, an interval is randomly selected, that 

shall be referred to as the current interval (see step 1402). 

If the cardinality of the current interval is sufficiently small (see step 1403), 
then a value from the interval can be selected at random (see step 1404). If the 
cardinality of the current interval is too large, the following iterative relaxation 

20 procedure can be used to reduce its cardinality before selection of a single value 
is performed. 

First, the current interval is divided into a pre-determined number of 
smaller intervals (see step 1405). In some embodiments, the iterative relaxation 
procedure divides the current interval into two approximately equal-sized 
25 intervals. Then, iteratively, one of the smaller intervals is picked at random as the 
new current interval (see step 1406). 

If the smaller intervals, available for selection as a new current interval, 
have been exhausted (see step 1407), then either iterative relaxation ends in 
failing (see step 1409) to find an acceptable value (if it is not currently executing 
30 from a recursion as show in step 1408), or it returns from the current recursion 



Page 47 of 97 



Express Mail Number EU893-957-195US 

MA Iyer 

level (see step 1410). The return from the current recursion goes back to step 
1406, of the higher level invocation, of iteratively selecting one of the smaller 
intervals such that another such smaller interval can be tried. The return from 
the current recursion is represented in Figure 14 by a dashed arrow (labeled 
5 1413) that starts at 1410, a descriptive box regarding how such return is 
accomplished, and goes to the step (see 1406) of selecting the next smaller 
interval. 

If, however, the smaller intervals, available for selection as a new current 
interval, have not been exhausted, then the iterative relaxation process 

10 continues by performing an implication process (see step 1411). The implication 
process finds any implications resulting from the limiting of the current interval to 
the new current interval. If a conflict (see step 1412) results from such 
implication process, then it is known that, for the entire current interval, there is 
no valid single value that can be chosen. In this situation, one of the other 

15 smaller intervals is selected instead (by step 1406) and the same process, of 
determining whether there are any valid values to be chosen in the new current 
interval, is repeated. If a conflict does not result from the implication process 
upon the new current interval, then the process recurses, with the current interval 
of the recursive invocation being the new current interval. Such a recursive call 

20 is represented in Figure 14 by a dashed arrow (labeled 1414) from the conflict 
testing step (1412) to the cardinality testing step (1403). 

The recursive invocation begins with dividing the current interval (now the 
new current interval) into smaller intervals (step 1405). Eventually, when the 
iterative relaxation search procedure has selected a current interval of sufficiently 

25 small size (step 1403 takes the "yes" path), a value of the current interval is 
randomly selected (by step 1404). 

If the iterative relaxation procedure operates by dividing the current 
interval into two approximately equal-sized intervals, then it has implemented a 
kind of binary search. 
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A major benefit of this technique is its elimination of invalid intervals from 
the range that is to be limited to a single value, thereby improving the probability 
that the value picked, from a remaining smaller current interval, is valid. 

A pseudo-code procedure for iterative relaxation is depicted in Section 
5 4.6. For the current dv, referred to in the pseudo-code as "decNode," the line of 
the pseudo-code labeled "1" randomly selects an interval referred to as "intl." 

Next, the pseudo-code tests labeled l.a.i and l.a.ii are evaluated. Test 
1 .a.i is satisfied if the cardinality of intl is above a certain pre-defined limitl . 
Test l.a.ii is satisfied if the cardinality of intl is above a pre-defined Iimit2, and if 
1 0 the backtracking history of decNode is sufficiently discouraging. 

If both of tests 1 .a.i and 1 .a.ii are not satisfied, then section of pseudo- 
code labeled 1 .b does a random selection of a value from intl . 

If, however, test l.a.i or l.a.ii is satisfied, then the pseudo-code steps 
labeled 1.a.ii.1 and l.a.ii. 2 are taken in order to further limit the size of intl 
1 5 before selecting a particular value. Step 1 .a.ii.1 divides intl into a set of smaller 
intervals, such set referred to as {int2}. Step 1 .a.ii.2 randomly selects one of the 
intervals of {int2}. After identifying a new current interval in step 1 .a.ii.2, referred 
to as a retRange object, the following steps, not shown in the pseudo-code, but 
discussed above, are taken. Using retRange for the impVals parameter, an 
20 implication process is performed through a call to the implication engine of 
ImplyValueslnCircuitFe. If the implication process is successful, the iterative 
relaxation process recurses in order to continue refining the size of the interval 
from an {int2} from which a particular value for the current dv will be chosen. On 
the other hand, if a conflict is encountered during the implication process, the 
25 entire retRange value is excluded from {int2}, and a new retRange value is 
selected. 

3.5 Backtracking And Gap Representation 

As presented in the above overview process, if a conflict is encountered, 

once a specific value is chosen for the current dv, backtracking is performed by 
30 selecting another value for the current dv. 
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As part of the backtracking mechanism, the specific value chosen for the 
current dv, that was determined to have produced a conflict, is excluded before 
the picking of another value for the current dv is performed. This is illustrated 
with Example 3 and its depiction in Figure 2. It can be verified that an implication 
5 process reduces the range values of variables "a"and "b" to {6:10} and {0:4} 
respectively. Assume that the procedure for limiting the current dv to a single 
value, which current dv is assumed to be a, limits a to the following value: a = 
{7:7}, In a subsequent implication, this value assignment backward propagates 
through the adder to result in b = {3:3}. This in turn implies that the output of the 

10 subtractor is {4:4}. This, however, represents a conflict because the output of 
the subtractor is {6:6} (or more precisely, because the intersection of the set 
containing the value 4 with the set containing the value 6 is the empty set). 
Consequently, we backtrack on variable "a" by excluding the value {7:7}. Thus 
the range of "a" is set to following: a = { {6:6}, {8:10} }. This implies the following 

15 range for the "b" variable: b = { {0:2}, {4:4} }. The process for solving the input 
constraint set continues, for example, by picking another value for "a," unless "a" 
has been exhausted, in which case the previously current dv is backtracked to. 
Eventually, the process of the present invention will determine that a = 8 and b = 
2 is the only solution to the input constrain set of Example 3. 

20 

3.6 Limiting The Interval-Cardinality Of A Range 

The implication algorithms of the implication process can be conservative, 

in the sense that when a compact range representation cannot be derived (either 
because of difficulties in crafting an algorithm for implication involving a particular 
25 operator or because the interval-cardinality of the resulting range would be too 
large), the implication process returns a broad range for the node, often limited 
only by the node's basic limitations of precision and sign. This approach is 
conservative since it only excludes those values from a range that have been 
definitely determined as not part of any solution to the input constraint set. 
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Note that while this approach sometimes leads to the retention of values 
known not to be part of a solution, such retention does not introduce serious 
performance issues, for many example input constraint sets, for at least the two 
following reasons. First, once a range is limited to a specific value, the constraint 
5 set representation is re-solved, through another application of the implication 
process, such that the selection of a value, which cannot be part of a solution, 
will be detected as introducing a conflict. Second, heuristic techniques, such as 
iterative relaxation, permit the present invention to efficiently handle ranges with 
large value-cardinality. 

10 

3.6.1 Limited Backward Implication: Bit Slice Operator 

As with case-based learning described above, the backward implication 

bit-slice technique described below is generally applicable to the annotation of 
word-level networks and is not limited to word-level networks as used for 
1 5 constraint set solving. 

For some operators backward implication is limited either because of 
algorithmic complexities or because of interval-cardinality explosion. For 
example, using a two-value data representation, it can be hard to perform 
backward implication across a bit slice operator. A bit-slice operator takes an 
20 input variable and selects, for output, the value of a range of bits of the input 
variable, where the range is specified by two other inputs to the bit-slice 
operator. This is illustrated using the following example (written in OpenVera), 
referred to as Example 5: 
Example 5: 
25 rand bit[31 : 0] a; 

constraint d { 
a[7:3] == 9; 

} 
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In Example 5, "a" is declared to be a random variable with a width of 32 
bits. Example 5 has a single constraint block, called d , containing a single 
constraint. 

A ternary bit slice operator for this constraint, as shown in Figure 7, has 

5 three inputs: variable a, a constant node with value {7:7} (for the upper or "u" bit 
of the bit slice) and a constant node with value {3:3} (for the lower or "I" bit of the 
slice). While the output of the bit slice operator is limited to the range {9:9}, it 
can be procedurally complex to backwards implicate the effect of the {9:9} range 
to the input variable a. This requires having an interval represent each gap, in 

10 the range of {0:2 32 -1}, imposed by the bit slice requiring, as the only values 
included in the range, those 32-bit numbers where the five bits numbered 3 
through 7 have the value 9. As discussed in another example below, with respect 
to the modulo operator, this is an interval-cardinality issue. In the case of the 
bit-slice operator, and also in the case of the modulo operator example, 

15 interval-cardinality can be reduced through introduction of an unknown (or "x") 
value in a range's representation. Another approach, however, is performing a 
conservative backward implication during a typical implication process (e.g., the 
maximum range for "a" is intersected with the current range for "a'). However, 
when an implication process is begun, where the range for variable "a" is limited 

20 to encompass a single value, the value is selected such that it at least satisfies 
the bit-slice constraints, which minimizes the amount of backtracking performed 
in finding a solution to the input constraint set. 

In some cases, where the number of possible values is large (for 
example, in the modulo example discussed below where the range is zero plus 

25 all even numbers), it can be desirable to select a value, for the rv being limited to 
a single value, that may not satisfy the constraint and then invoke backtracking 
when an impermissible value is selected (such as an odd number in the below 
modulo example). 

The rest of this section describes a procedure that is used to efficiently 
30 support backward implication of bit-slice operations by selecting a value, for the 
variable from which the bit slices are taken, that yields the required bit-slices. 
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The following discussion should also be understood in conjunction with the 
pseudo-code framework of Section 4.7.8. Section 4.7.8.1 addresses forward 
implication across bit-slice operators. Section 4.7.8.2 addresses backward 
implication by returning a conservative maximum interval. 
5 First, the generalized problem of satisfying a collection of bit-slice 

constraints applied to an rv "a" is described, followed by a step-by-step 
description of the procedure for selecting an initial value that at least satisfies 
such bit-slice constraints. 

While the below procedure is presented in terms of constraints, it can be 

1 0 applied more generally as an efficient way to support the determination of a 
value for a node, of a word-level network, that is an operand of several bit-slice 
operators. In the constraints domain, such operand node corresponds to a 
random variable node. More generally, however, the procedure evaluates a 
range of values for an operand node that satisfies at least all the bit-slice 

1 5 operators for which it is an operand. At the end of section 3.6.1 , an example 
application of the bit-slice solving technique to hardware synthesis is described. 

Consider an n-bit variable "a" which has one or more bit-slice constraints 
that may or may not overlap. The problem is to find a value for variable "a," that 
produces all the bit-slices required by its bit-slice constraints. This is illustrated in 

20 Figure 8. 

In Figure 8, there are three bit-slice constraints (C1, C2, and C3) for 
various (overlapping) bits of an n-bit variable, "a." For example, C1 is a 
constraint on a[p : q]. 

After implications, the output of all bit-slice operators will have the 
25 corresponding raceRange values for the bit-slices they model. The bit-slice 
handling algorithm consists of the following steps: 

1. Convert the problem of r bit-slice constraints for an rv "a," which may be 
overlapping and which may not specify the entire bit range of "a," into an 
equivalent problem of (r + s) non-overlapping bit-slice constraints whose 

30 concatenation equals the entire bit range of "a." 

2. Using the raceRange value of the n-bit variable "a," and the raceRange values on 
the outputs of all the bit-slice operators that model the r bit-slice constraints on 
variable a, compute raceRange values for all the (r + s) non-overlapping bit-slice 
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constraints. The non-overlapping ranges are identified by marking, upon the bit 
range of variable "a," the begin and end bit of each of the r constraints. Such bits 
are referred to herein as "marking bits." Each range of bits in the range of "a," 
that is bracketed by a pair of marking bits, and does not contain any other 
5 marking bits within itself (i.e., other than one or both of the pair of bracketing 

marking bits), is a non-overlapping range. The concatenation of all such 
non-overlapping ranges produces a complete bit range for "a." The computation 
of the range of permissable values, for each such non-overlapping range, 
involves extracting the appropriate bits from each of the r bit-slice constraints 

1 0 whose range overlaps, to some extent, the non-overlapping range currently being 

processed. The extracted bits are converted into ranges that are appropriately 
intersected. Lastly, the range produced for each non-overlapping range (where 
each such range can be expressed as a raceRange data structure) is intersected 
with the range (or raceRange data structure) for variable "a" to further refine the 

1 5 newly determined raceRange value for each non-overlapping bit-slice constraint. 

3. If the raceRange value for any non-overlapping bit-slice constraint is empty, as 
computed in Step 2, return FAILURE. This represents a case where overlapping 
bit-slice constraints cannot be solved-for simultaneously. 

4. Using the computed raceRange values for all the (r + s) non-overlapping bit-slices 
20 in Step 2, randomly select a value, for each of the non-overlapping bit-slice 

constraints, using the computed raceRange value for that slice. 

5. Concatenate in sequence all the selected raceRange random values of Step 4 to 
generate a complete random value for the variable "a" that is at least in accord 
with its bit-slice constraints. 

25 6. If the random value for variable a in Step 5 is not a legal value repeat from Step 4 

for a pre-determined number of times. 

The above steps 1-6 are also addressed by Figure 12, which illustrates 
the following steps. Steps 1201 to 1203 of the process of Figure 12 iterate over 
30 each bit-slice constraint, of the constraint set representation, that select from the 
same variable "a." The current bit-slice constraint, being processed by the loop 
of steps 1201-1203, is referred to as the "current bit-slice constraint." For each 
current bit-slice constraint, its marking bits, relative to the variable "a," are 
denoted. Step 1203. 

35 When the loop of steps 1201-1203 is completed, the "no" branch of step 

1202 is taken such that the loop of steps 1204-1207 can be started. The loop of 
steps 1204-1207 iterates over each non-overlapping constraint, identified by the 
marking bits of the previous loop. The current non-overlapping bit-slice 
constraint, being processed by the loop of steps 1204-1207, is referred to as the 

40 "current non-overlapping bit-slice constraint." For each current non-overlapping 
bit-slice constraint, the bit-slice contraints of the constraint set representation, 
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that intersect with the current non-overlapping bit-slice constraint, are identified. 
Step 1206. In addition, for each bit-slice contraint of the constraint set 
representation identified, step 1206 extracts the portion of its range that 
intersects with the range of the current non-overlapping bit-slice constraint. In 
step 1207, such extracted ranges are intersected to produce a range for the 
current non-overlapping bit-slice constraint. 

When the loop of steps 1204-1207 is completed, the "no" branch of step 
1205 is taken such that a value for the variable "a," that satisfies all of its bit-slice 
constraints of the constraint set representation, can be generated by step 1208. 

In order to illustrate this step-by-step procedure in the example of 
Figure 8, assume that the original ranges associated with the variable a, a[x : y], 
a[v : w], a[p : q] be R, R2, R3, and R1 respectively. This overlapping bit-slice 
problem will be divided into 7 non-overlapping slices, whose concatenation 
completely covers the bit range of "a," as follows: > 

1 . a[n : x] 

2. a[x-1 : v] 

3. a[v-1 : p] 

4. a[p-1 : y] 

5. a[y-1 : q] 

6. a[q-1 : w] 

7. a[w-1 : 0] 

Next, we illustrate how the raceRange value for one of these non- 
overlapping slices is computed. Lets consider computing the raceRange value 
for the non-overlapping slice a[p-1 : y]. This is done in the following steps: 

1 . Extract a raceRange r1 from R1 by performing a bit-slice operation on R1 for bits [p-1 : 

y] 

2. Extract a raceRange r2 from R2 by performing a bit-slice operation on R2 for bits [p-1 : 

y] 

3. Extract a raceRange r3 from R3 by performing a bit-slice operation on R3 for bits [p-1 : 

y] 

4. Extract a raceRange r4 from R by performing a bit-slice operation on R for bits [p-1 : y] 

5. The raceRange value for the non-overlapping slice a[p-1 : y] is computed as r - 
(r1 n r2 n r3 n r4) 

Next, a random value is picked from the newly computed raceRange 
value, r, for the non-overlapping slice a[p-1 : y]. Similarly, such raceRange 
values are computed for all other non-overlapping slices and a random value is 
selected for each of them. All these random values for all the non-overlapping 
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slices are concatenated in the order sequence listed above to compute a new 
random value for variable a. This value is then used as a decision value for 
implications. 

A specific example, in accordance with Figure 8, is depicted in Figure 9. 
This example assumes that "a" is a 14-bit variable, and that the constraints are 
as follows: 

C1:a[7:3]<8 

C2:a[11:4] = 65 

C3: 12 <= a[9:1]<25 
The backward-implied overlapping ranges for "a" are as follows. Please 
note that the "x" value is being used below for purposes of explanation and that 
an implementation need not use an "x" value: 

Rl: {xxxxxxOOOOOxxx : xxxxxxOOlllxxx} 
{xx01000001xxxx : xxOlOOOOOlxxxx} 
{xxxxOOOOOHOOx : xxxxOOOOHOOOx} 

The seven non-overlapping ranges extracted from R1-R3 are as follows: 

a [13 :11] : 



R2 
R3 



rl 
r2 
r3 



{xxx 
{xxO 
{xxx 



xxx} 
xxO } 
xxx} 



intersection: {xxO 
to {000 : 110} 



xxO}, which translates 



a [10:9] 
rl 
r2 
r3 



{xx 
{10 
{xO 



xx} 
10} 
xO} 



intersection: {10 : 10} 



a[8:7] : 
rl 
r2 
r3 



{xO 
{00 
{00 



xO} 
00} 
00} 



intersection: {00 : 00} 



a [6 :4] : 
rl 



{000 : Oil} 
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r2 
r3 



{001 
{001 



001} 
011} 



intersection is: {001 : 001} 



a[3:3] 



rl 
r2 
r3 



{0 
{x 
{0 



1} 
x} 
1} 



intersection is: {0 : l} 



a[2:l] : 
rl 
r2 
r3 



{xx 
{xx 
{00 



xx} 
xx} 
00} 



intersection is: {00 : 00} 



a [0 :0] : 
rl 
r2 
r3 



{x 
{x 



x} 
x} 
x} 



intersection is: {x 
{0 : 1} 



x} , which translates to 



In the area of hardware synthesis, the above-described bit-slice solving 
technique can be applied as follows. A hardware design (expressed, for 
example, in a high-level hardware design language such as Verilog), can contain 
an input bus, along with several bit-slice operators that specify portions of the 
bus for use in different sections of the design. Based upon the circuitry such 
bit-slices participate in, the above-described procedure can be used to 
determine, for example, that the input bus can be of significantly narrower 
bit-width than had originally been specified for it. 



35 3.6.2 Limited Backward Implication: Modulo Operator 

An example constraint (written in OpenVera) of where interval-cardinality 

would be too large is as follows, labeled Example 2: 
Example 2: 
rand bit[31 : 0] a; 
40 constraint c1 { 
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a mod 2 == 0; 
} 

In Example 2, "a" is declared to be a random variable with a width of 32 
bits. Example 2 has a single constraint block, called d , containing a single 
5 constraint. The constraint states that any value assigned to "a," when a modulo 
two operation is performed on it, the result must be zero. 

Figure 5 depicts a corresponding constraint set representation for 
Example 2. Based upon the output of the MOD operator being limited to {0:0}, 
and the right input being limited to {2:2}, backward implication would indicate that 
1 0 the range of "a" should only include the number zero (expressed as the interval 
{0:0}) and all even numbers from 2 through 2 32 - 2. Thus, the range of "a" 
should be expressed as comprising 2 31 (or two billion) intervals, which range 
would appear as follows: a = {{0:0}, {2:2}, {4:4}, ...{2 32 -2 : 2 32 - 2} }. 

Assuming, however, that an interval-cardinality for "a"of two billion is 
15 larger than desired, given computational resources, the range for "a" can be 
expressed, conservatively, as shown in Figure 5, by the following single interval: 
a = {0: 2 32 - 1 }. 

In other cases, however, the interval-cardinality may be sufficiently small 
such that the fully accurate results of the implication process can be expressed 
20 in a range. For example, consider the constraint (a > 2 && a < 7) || (a >= 1 1 ), 
where "a" is a 4-bit unsigned random variable. Here, the possible values for "a" 
are {0:15}. The implication process results in a range for "a" with the following 
two intervals: a = {{3:6}, {11:15} }. 



25 3.7 Limiting The Implication Process: Cyclic Behavior 

The implication process, on certain configurations of ranges and 

operators, can have cyclic behavior. This is demonstrated in the following 
example, labeled Example 4. 

Example 4: Consider the following constraints. 
30 rand bit [3 : 0] a, b; 
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constraint c1 { 
a + b>4'd14; 
a<4'd15-b; 
} 

5 Example 4 (written in OpenVera), declares two random variables "a" and 

"b," each of which is four bits in width. The constraint block c1 contains two 
constraints, both of which must be satisfied. 

For simplicity, assume that all node evaluations are performed with 4-bit 
unsigned precision semantics. Figure 6A illustrates the high-level constraint set 

1 0 representation for Example 4 . 

Since a+fo > 14, we conclude that node y = {15:15}. Forward evaluating 
the node x, we get x = {0:15} (using RTL-Verilog wrap-around semantics). This 
implies a = {0:14} through backward propagation across the < comparator. 
Backward evaluation to node "£>"from the output of the adder using the new 

15 value of "a"gives b = {1:15}. This in turn implies x = {0:14}. This in turn implies 
a = {0:13}. This implication cycle will continue as x => a => b => x => a ... This 
cycle is depicted in Figure 6B. Note that in every iteration, as nodes get re- 
evaluated, their value range keeps shrinking, thereby giving rise to new 
implications. If we follow this implication through, we will discover that the range 

20 values on "a" and "b"will become empty, thereby representing a conflict in the 
constraints. 

From a theoretical standpoint, for any particular assignment of ranges, 
successive application of the implication process will converge. However, to 
impose an upper limit on the implication process, particularly in those cases 
25 where cyclic implications arise, it may be preferable to detect cyclic implication 
processes and to end such cycles after a predetermined number of iterations. 

4. Pseudo-Code Listings 

4. 1 Top-level function for implication engine 

30 
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I* Top-level function for implication engine. 

* impVals is a table of node-value pairs to be implied 

* nodeslmplied is the table of node-value pairs that are implied 

7 

Boolean ImplyValueslnCircuitFe (impVals, nodeslmplied) { 

1 . Set the initial values in the passed-in impVals table to the corresponding 
nodes. All these node-value pairs are also inserted in the passed-in 
nodeslmplied table. 

2. Create the initial forward and backward queues. A forward and backward 
queue is maintained for each level of the levelized circuit on which 
implications are performed. The fanout nodes of all non-primary-output nodes 
in the nodeslmplied table are added to the corresponding forward queue. All 
non-primary-input nodes in the nodeslmplied table are added to the 
corresponding backward queue. 

3. retVal = Forwardlmply(forwardQueues, backwardQueues, nodeslmplied): 
This step performs all forward implications by processing all forwardQueues 
in order, starting with the lowest level. As part of implying forward on a node, 
other nodes may get scheduled for forward propagation and the node itself 
may get scheduled for backward propagation. 

4. IfretVal 

a. retVal = Backwardlmply(forwardQueues, backwardQueues, 
nodeslmplied): This step performs all backward implications by 
processing all backwardQueues in order, starting with the highest 
level. As part of implying backward on a node, other nodes may get 
scheduled for backward propagation and the node itself may get 
scheduled for forward propagation. 

5. If retVal && pending events in forward or backward queues 

a. go to Step 3. 

6. return retVal. 

) 



4.2 Forward Implication 

I* This function is the core forward implication engine 7 

Boolean Forwardlmply (forwardQueues, backwardQueues, nodeslmplied) { 

1 . Get lowest level forwardQueue. Let this queue be forwardEvents. If 
forward Events is empty, go to Step 3. 
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2. foreach node in forward Events 

a. newValue = forward evaluate node 

b. oldValue = current value of node 

c. if newValue == oldValue 

5 i. Schedule node for backward implications 

d. Else 

i. intersectValue = newValue f| oldValue 

ii. if intersectValue 

1 . Store node-intersectValue-pair in nodeslmplied 
1 0 2. Set value of node to intersectValue 

3. Schedule node for backward implications 

4. Schedule fanout nodes of node for forward implications 

iii. Else return false 

3. return true 

15 } 

4.3 Backward Implication 

/* This function is the core backward implication engine */ 

boolean Backwardlmply (forwardQueues, backwardQueues, nodeslmplied) { 

1 . Get highest-level backwardQueue. Let this queue be backward Events. If 
20 backwardEvents is empty, go to Step 3. 

2. Foreach node in backwardEvents 

a. Foreach input_node of node 

i. If value of input_node is not a singleton value 

1 . newValue = backward evaluate to input_node 
25 2. OldValue = old value of inputNode 

3. intersectValue = newValue fl oldValue 

4. if intersectValue is empty, return false 

5. if newValue != oldValue 

a. Store node-intersectValue-pair in nodeslmplied 
30 b. Set value of node to intersectValue 

c. Schedule input_node for backward implications 
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d. Schedule all fanout nodes of inputNode for 
forward implications 

3. return true. 



4.4 Case-Based Learning 

I* Top-level function for performing recursive and global learning, as applied to an initial 
implication process (such as step 302 of Figure 3), as opposed to an implication process 
performed after a dv has been limited to a single value (such as step 307 of Figure 3). 

7 

boolean PerformLearninglnCircuitFe(raceCircuit) { 

1 . Foreach unjustified Boolean node in raceCircuit 

a. recursiveLearnDepth = 0; 

b. retVal = PerformLearninglnCircuit(raceCircuit, node, learnedlmps, 
recursiveLearnDepth) 

c. IfretVal 

i. retVal = lmplyValueslnCircuitFe(learnedlmps, nodeslmplied) 

d. else return retVal 

2. return retVal 

} 

/* Core learning engine 7 

boolean PerformLearninglnCircuit(raceCircuit, node, learnedlmps, 
recursiveLearnDepth) { 

1 . failCount = 0 

2. Foreach inputjiode of node 

a. sel_value = (controlling value for node using precision and sign of 
input_node) fl (current value of inputjiode) 

b. retVal = RecursivelmplyDecisionValue(raceCircuit, inputjiode, selj/alue, 
nodeslmplied, recusriveLearnDepth) 

c. IfretVal 

i. if first inputjnode 

1 . learnedlmps = nodeslmplied 

ii. else 

1 . Foreach impliedNode in learnedlmps 
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a. If impliedNode exists in nodeslmplied 

i. unionValue = (value of impliedNode in 
learnedlmps) U (value of impliedNode in 
nodeslmplied) 

ii. insert impliedNode-unionValue pair in 
newLearnedlmps 

2. learnedlmps = newLearnedlmps 

d. else 

i. excludeValue = exclude sel_value from current value of input_node 

ii. Insert input_node-excludeValue pair in excludelmps 

iii. Increment failCount 

e. Restore to state of the circuit before step 1 c. 

3. if failCount != 2 

a. learnedlmps = learnedlmps n excludelmps 

b. return true 

4. else 

a. Empty learnedlmps table 

b. Return false 

} 

/* Core top-level function to perform recursive implications for the 
* passed-in node and sel_value. 

7 

boolean RecursivelmplyDecisionValue(raceCircuit, input_node, sel_value, 
nodeslmplied, recursiveLearnDepth) { 

1 . Insert input_node-sel_value pair in impVals table 

2. retVal = lmplyValueslnCircuitFe(impVals, nodeslmplied) 

3. if retVal && (recursiveLearnDepth < MAX_RECURSIVE_LEARN_DEPTH) 

a. unjustNodes = list of unjustified nodes in nodeslmplied 

b. sort unjustNodes based on reverse levelized order 

c. retVal = RecursiveLeamAndlmply(raceCircuit, unjustNodes, nodeslmplied, 
recursiveLearnDepth) 

d. if retVal && (recursiveLearnDepth == 0) 

i. unjustNodes = list of all unjustified Boolean nodes in raceCircuit that 
are within a pre-defined number of levels of logic from input_node 

ii. sort unjustNodes based on reverse levelized order 

iii. retVal = RecursiveLeamAndlmply(raceCircuit, unjustNodes, 
nodeslmplied, recursiveLearnDepth) 
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4. return retVal 

} 

/* Core function to recursively learn implications for all nodes in 
5 * the passed-in unjustNodes list 

7 

boolean RecursiveLearnAndlmply(raceCircuit, unjustNodes, nodeslmplied) { 

1 . foreach unjustjiode in unjustNodes 

a. iffirstNode 

10 i. Increment recursiveLearnDepth 

b. retVal = PerformLeaminglnCircuit(raceCircuit, unjustjiode, learnedlmps, 
recursiveLearnDepth) 

c. if retVal 

i. retVal = lmplyValuelnCircuitFe(learnedlmps, nodeslmplied) 

1 5 2. return retVal 

} 

4.5 Cost Function For Decision Variable Selection 

1 . Foreach decNode in currently unassigned list of random variables 

20 a. Compute nodeScore as a score for the node by multiplying the following 

quantities 

i. The number of fanout nodes of decNode 

ii. The cardinality of the number of singleton values in the current 
raceRange value of decNode 

25 iii. The cumulative backtrack count for decNode for a pre-defined 

number of past calls to the overall constraint-solving procedure that 
finds solutions to the same input constraint set. 

b. Insert decNode-nodeScore pair in a decList list of decision nodes 

2. Sort decList in ascending order of the computed scores. 
30 3. Foreach decNode in decList 

a. if 

i. decNode is the first node OR 

ii. (Score for decNode is within a pre-defined percentage of the 
previous node) && (the total number of nodes in prunedList has not 

35 exceeded a pre-defined limit) 

1 . Insert decNode in prunedList 

b. Else 
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i. Return prunedList 
4. return prunedList 



4.6 Iterative Relaxation 

5 1 . For a decision variable, decNode and a randomly selected racelnterval, int1 , 

a. If 

i. The cardinality of int1 is bigger than a pre-defined limit, limitl OR 

ii. (The cardinality of int1 is bigger than a pre-defined limit, Iimit2 [where 
Iimit2 < limitl]) && (The current backtrack count for decNode during 

1 0 this solver run or the cumulative backtrack count of decNode across 

a pre-defined number of past solver runs for the same constraint 
problem, exceed pre-defined limits) 

1 . Split int1 into a pre-defined number of smaller intervals. Let 
these smaller intervals be {int2} 

15 2. retRange = raceRange value representing a randomly 

selected interval from {int2} 



b. else 



retRange = raceRange value representing a randomly selected 
singleton value from int1 



20 2. return retRange 



4.7 Operator-Specific Implication 

This section presents pseudo-code for forward and backward implication 

25 across various high-level operators. 

Ranges are represented in the pseudo-code by object-oriented 
programming (OOP) objects of type raceRange. A racelnterval is comprised of a 
pair of OOP objects of type raceDataType, that represent the lower and upper 
bound of the racelnterval object. 

30 A raceRange is comprised of a list of intervals, comprised of OOP objects 

of type racelnterval. While the forward and backward propagation algorithms 
operate on raceRange objects, at the core of each implication procedure is the 
implication of racelnterval objects across an operator. 
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For example, to forward implicate values of a raceRange object across an 
adder, whose inputs are "a" and "b," first the intervals, resulting from forward 
implicating on a pairwise basis each racelnterval combination, are computed. 
The resultant racelnterval objects are merged to create a list of canonical (or 

5 non-overlapping) racelnterval objects. This list of racelnterval objects comprises 
a new raceRange object that represents the result of the forward implication. The 
operator-specific pseudo-code of this Section focuses only on the racelnterval 
level of implication. The pseudo-code also assumes that the low-level 
procedures, for performing primitive operations on raceDataType objects, are 

1 0 available. For example, it is assumed that there exists a procedure to multiply 
two raceDataType objects. 

A racelnterval object is comprised of a pair of OOP objects of type 
raceDataType. A raceDataType object can represents a number with a bit-width 
of up to (2 32 - 1 ) bits, and the number can be signed or unsigned. 

1 5 The following terminology is used in the pseudo-code. The input 

racelnterval objects are represented as { 11 : M }, { 12 : h2 }, { 13 : h3}. The input 
racelnterval is limited to three intervals, for the purposes of illustration, since the 
operators illustrated by pseudo-code can only have up to three inputs. The 
racelnterval object on the output of an operator is represented as { o1 : o2}. 

20 The following pseudo-code procedure is used by various of the below- 

given operator-specific implication procedures: 

r Ihslnterval = {MM}, rhslnterval = {I2:h2} */ 

racelnterval racelntersectlnterval(lhslnterval, rhslnterval) { 

25 if (Ihslnterval and rhslnterval overlap) { 

01 = Maximum of 11 and 12 

02 = Minimum of hi and h2 
return {o1 :o2} 

} 

30 else{ 

return 0 

} 
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} 



4.7.1 Arithmetic Operators 

5 4.7.1.1 Forward Propagation 

+ Operator: 

r Ihslnterval = {I1:h1}, rhslnterval = {I2:h2} 7 
racelnterval raceAddlnterval(lhslnterval, rhslnterval) { 

return { (11+12) :(h1+h2)} 

10 } 



Operator: 



15 



20 



Operator: 



25 



r Ihslnterval = {I1:h1}, rhslnterval = {I2:h2} 7 

list raceSubtractlnterval(lhslnterval, rhslnterval) { 

retList = list containing intervals { (I1-h2) : (11-12) }, 

{ (11-12) :(h1- 12)} 
Merge overlapping intervals in retList from the above operation 
return retList 

} 



r Ihslnterval = {I1:h1}, rhslnterval = {I2:h2} 7 

racelnterval raceMultiplylnterval(lhslnterval, rhslnterval) { 

01 = Minimum of (11 * 12), (hi * h2), (11 * h2), and (hi * 12) 

02 = Maximum of (11 * 12), (hi * h2), (11 * h2), and (hi * 12) 
retlnterval = (o1 :o2} 

return retlnterval 

} 



30 / Operator: 



35 



/* Ihslnterval = {I1:M}, rhslnterval = {I2:h2} 7 

racelnterval raceDividelnterval(lhslnterval, rhslnterval) { 

retlnterval = 0 

if (rhslnterval does not have value 0) { 

o1 = Minimum quotient of (11 / 12), (11 / h2), (hi / 12), and (hi / h2) 
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o2 = Maximum quotient of (11 / 12), (11 / h2), (hi / 12), and (hi / h2) 
retlnterval = {o1 :o2} 

} 

return retlnterval 

5 } 



% Operator: 

I* Ihslnterval = {I1:h1}, rhslnterval = {I2:h2} 7 

racelnterval raceModulolnterval(lhslnterval, rhslnterval) { 

10 Notation: |p| = absolute value of p 

q* = two's complement of q 
if (Ihslnterval and rhslnterval are values) { 
retlnterval = {11 % 12 : 11 % 12} 

} 

1 5 else { 

if (Ihslnterval is negative && rhslnterval is negative) { 
retlnterval = {0:min(|M |, |I2|-1)} 

} 

else if (Ihslnterval is negative && rhslnterval is positive) { 
20 retlnterval = {max(H , (h2 - 1 )*) : 0} 

} 

else if (Ihslnterval is negative && 

rhslnterval is negative and positive) { 
retlnterval = {max(H , (h2 - 1 )*) : min(|H |, (|I2| - 1 ))} 

25 } 

else if (Ihslnterval is positive && rhslnterval is negative) { 
retlnterval = {max(h1*, (12 + 1)) : 0} 

} 

else if (Ihslnterval is positive && rhslnterval is positive) { 
30 retlnterval = {0 : min(h1 , (h2 - 1 ))} 

} 

else if (Ihslnterval is positive && 

rhslnterval is negative and positive) { 
retlnterval = {max(h1*, (12 + 1)) : min(h1, (h2 - 1))} 

35 } 
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else if (Ihslnterval is negative and positive && 
rhslnterval is negative) { 
retlnterval = {max(h1*, (12 + 1)) : min(|H|, (|I2| - 1))} 

} 

5 else if (Ihslnterval is negative and positive && 

rhslnterval is positive) { 
retlnterval = {max(M , (h2 - 1 )*) : min(h1 , (h2 - 1 ))} 

} 

else if (Ihslnterval is negative and positive && 
1 0 rhslnterval is negative and positive) { 

retlnterval = {max(H, (h2 - 1)*, h1* f (12 + 1)) : 
min(|H|, (|!2|-1),h1,h2-1)} 

} 

} 

1 5 return retlnterval 

} 

Unary Minus Operator: 

/* operand = {l:h} 7 

20 list raceUnaryMinuslnterval(operand) { 

retList = list containing one interval which is two's complement 

of operand evaluated in one more bit than that of operand and 
accounting for any wrap-around semantics for unsigned intervals 

return retList 

25 } 



4.7.1.2 Backward Propagation 
+ Operator: 

30 /* result = {o1:o2}, operand = {l:h} 7 

list raceBackAddlnterval(result, operand, numBits, sign) { 

retList = raceSubtractlnterval(result, operand) 
minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
35 maxlnterval = {minLow:maxHigh} 
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retList = list of intervals resulting from intersecting 

each interval in retList with maxlnterval 
return retList 

} 

5 - Operator: 

r result = {o1:o2}, rhslnterval = {I2:h2} 7 

list raceBackLhsSubtractlnterval(result, rhslnterval, numBits, sign) { 

retList = list containing only one interval { (o1 +12) : (o2+h2) } evaluated in numBits 
precision 

10 return retList 

} 



/* result = {o1:o2}, Ihslnterval = {I1:h1} 7 

list raceBackRhsSubtractlnterval(result, Ihslnterval, numBits, sign) { 

1 5 retList = raceSubtractlnterval(lhslnterval, result) 

retList = list of intervals resulting from converting all 

intervals in retList to numBits precision 
return retList 

} 

20 

* Operator: 

/* result = {o1:o2}, operand = {l:h} 7 

list raceBackMultiplylnterval(result, operand, numBits, sign) { 

minLow = Minimum value for numBits and sign 
25 maxHigh = Maximum value for numBits and sign 

maxlnterval = {minLow:maxHigh} 
if (result has a 0 and operand has a 0) { 

retList = list containing only maxlnterval 

} 

30 else{ 

operandList = list of interval(s) by excluding 0 from operand 
foreach operand in operandList { 
newlnterval = raceDividelnterval(result, operand) 
intervalList = list of interval(s) by excluding 0 from newlnterval 
35 foreach interval in intervalList { 

newList = list of interval(s) by expressing interval in numBits 
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precision 
Append newList to retList 

} 

} 

Sort retList based on the low data of the intervals and merge any 
overlapping intervals 

} 

return retList 

} 



10 



/ Operator: 



/* result = {o1:o2}, rhslnterval = {I2:h2} 7 

list raceBackLhsDividelnterval(result, rhslnterval, numBits, sign) { 

retList = 0 

15 if (rhslnterval does not have a 0) { 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
maxlnterval = {minLow:maxHigh} 
templnt = raceMultiplylnterval(result, rhslnterval) 
20 if (rhslnterval !={1:1}){ 

templnt = Pad boundaries of templnt with absolute maximum remainder 
value computed from rhslnterval 

} 

newlnt = racelntersectlnterval(templnt, maxlnterval) 
25 retList = list of intervals computed by expressing newlnt in numBits 

precision 

} 

return retList 



} 



30 



I* result = {o1:o2}, Ihslnterval = {I1:h1} 7 

list raceBackRhsDividelnterval(result, Ihslnterval, numBits, sign) { 

retList = 0 

minLow = Minimum value for numBits and sign 
35 maxHigh = Maximum value for numBits and sign 

maxlnterval = {minLow:maxHigh} 
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if (result does not have a 0) { 

templnt = raceDividelnterval(lhslnterval, result) 
if(templnt){ 

tempList = list of intervals by excluding 0 from templnt 

foreach interval in tempList { 

newlnterval = racelntersectlnterval(interval, maxlnterval) 
newList = list of intervals computed by expressing newlnterval 

in numBits 
Append newList to retList 

} 

} 

} 

else{ 

retList = list of intervals resulting by excluding 0 from maxlnterval 

} 

return retList 

} 

% Operator: 

r result = {o1:o2} */ 

/* In this case, given that the precise solution may result in many split intervals, we 
conservatively return the maxlnterval 

*/ 

list raceBackModulolnterval(result, numBits, sign) { 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
maxlnterval = {minLow : maxHigh} 
retList = list containing only maxlnterval 
return retList 

} 

Unary Minus Operator: 

/* result = {o1:o2}*l 

list raceBackllnaryMinuslnterval(result, numBits, sign) { 

minList = raceUnaryMinuslntetval(result) 

retList = list of intervals by converting all intervals in minList to 



Page 72 of 97 



Express Mail Number EU893-957-195US 

M.A. Iyer 

numBits precision 
return retList 

} 

5 4.7.2 Relational Operators 

4.7.2.1 Forward Propagation 

>= Operator: 

1 0 r Ihslnterval = {I1:M}, rhslnterval = {I2:h2} *l 

racelnterval raceGtelnterval(lhslnterval, rhslnterval) { 

if (11 >=h1){ 

01 =1 

02 = 1 

15 } 

else if (hi <I2){ 
o1 =0 
02 = 0 

} 

20 else { 

01 =0 

02 = 1 

} 

return {o1 :o2} 

25 } 
> Operator: 

{11 :M}> {12 : h2 } is algorithmically modeled as [ I ( { 12 : h2} >= { 11 : M } ) ] 

30 <= Operator: 

{11 : M } <= {12 : h2 } is algorithmically modeled as [({12: h2} >={I1:M})] 

< Operator: 

{11 :M}< {12 : h2 } is algorithmically modeled as [({12: h2} >{I1 :M})\ 

35 
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Operator: 

r Ihslnterval = {I1:h1}, rhslnterval = {I2:h2} 7 
racelnterval raceEqlnterval(lhslnterval, rhslnterval) { 

if ((11 == hi ) && (12 == h2) && (11 == 12)) { 

01 =1 

02 = 1 

} 

else if (Ihslnterval and rhslnterval overlap) { 
o1 =0 
o2 = 1 

} 

else{ 

01 =0 

02 = 0 

} 

return {o1 :o2} 

} 

!= Operator: 

20 {11 : hi } != {12 : h2 } is modeled as [ ! ( {11 : hi } == {12 :h2})] 

4.7.2.2 Backward Propagation 
>= Operator: 

r Ihslnterval = ff1:M}, rhslnterval = {I2:h2}, result = {o1:o2} 7 
25 racelnterval raceBackLhsGtelnterval(result, rhslnterval, numBits, sign) { 

Ihslnterval = 0 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
if (result =={0:0}) { 
30 if ((h2-1)>= minLow) { 

11 = minLow 

hi = Minimum of (h2-1 ) and maxHigh 
Ihslnterval = {11 :h1} 

} 

35 ) 

else if (result == {1:1}) { 
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if (maxHigh >= (Maximum of minLow and 12)) { 

11 = Maximum of minLow and 12 
hi = maxHigh 

Ihslnterval = {l1:h1} 

} 

} 

else if (result =={0:1}){ 

Ihslnterval = {minLow:maxHigh} 

} 

return Ihslnterval 

> 

r Ihslnterval = Q1:h1}, rhslnterval = {I2:h2}, result = {o1:o2} *l 

racelnterval raceBackRhsGtelnterval(result, Ihslnterval, numBits, sign) { 

rhslnterval = 0 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
if (result == {0:0}) { 
if (maxHigh >=(I1+1)){ 

12 = Maximum of (11 +1 ) and minLow 
h2 = maxHigh 

rhslnterval = {I2:h2} 

} 

} 

else if (result =={1:1}){ 

if ((Minimum of maxHigh and h2) >= minLow) { 
12 = minLow 

h2 = Minimum of maxHigh and h2 
rhslnterval = {I2:h2} 

} 

} 

else if (result == (0:1)) { 

rhslnterval = {minLow:maxHigh} 

} 

return rhslnterval 

} 
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> Operator: 

{11 :M}> {12 : h2 } is algorithmically modeled as [ ! ( {12 : h2} >= {11 :M})] 



5 <= Operator: 

{ 11 : M } <= {12 : h2 } is algorithmically modeled as [({12: h2} >={I1 :M})] 



< Operator: 

{11 :M}<{!2 : h2 } is algorithmically modeled as [{{12: h2} >{I1:M})] 

10 

== Operator: 

/* operand = {l:h}, result = {o1:o2} */ 

list raceBackEqlnterval(result, operand, numBits, sign) { 

retList = 0 

1 5 minLow = Minimum value for numBits and sign 

maxHigh = Maximum value for numBits and sign 

maxlnterval = {minl_ow:maxHigh} 

retList = list containing maxlnterval 

if (result == {0:0}) { 
20 if (I == h){ 

retList = Intervals resulting by excluding operand from maxlnterval 

} 

} 

else if (result =={1:1}){ 

25 retList = racelntersectlnterval(operand, maxlnterval) computed in 

numBits precision 

} 

else if (result != {0:1 }){ 
retList = 0 

30 } 

return retList 

} 



35 != Operator: 

{11 :h1}!={!2 : h2 } is modeled as [! ({11 : hi } == { 12 : h2 } )] 
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4.7.3 Boolean Operators 

4.7.3.1 Forward Propagation 
&& Operator: 

I* Ihslnterval = {I1:h1}, rhslnterval = Q2:h2) 7 

racelnterval raceBoolAndlnterval(lhslnterval, rhslnterval) { 

if (Ihslnterval == {0:0} || rhslnterval == {0:0}) { 
o1 =0 
o2 = 0 

} 

else if (Ihslnterval does not have 0 && 
rhslnterval does not have 0) { 

01 =1 

02 = 1 

} 

else{ 

01 =0 

02 = 1 

} 

return {o1 :o2} 

} 

|| Operator: 

/* Ihslnterval = {I1:h1}, rhslnterval = {I2:h2} 7 

racelnterval raceBoolOrlnterval(lhslnterval, rhslnterval) { 

if (Ihslnterval == {0:0} && rhslnterval == {0:0}) { 
o1 =0 
o2 = 0 

} 

else if (Ihslnterval does not have 0 j| 

rhslnterval does not have 0) { 

01 =1 

02 = 1 
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else{ 

01 =0 

02 = 1 

} 

return {o1:o2} 

} 

! Operator: 

/* operand = {l:h} 7 

racelnterval raceBoolNegatelnterval(operand) { 

if (operand == {0:0}) { 
o1 = 1 
o2 = 1 

} 

else if (operand does not have 0) { 

01 =0 

02 = 0 

} 

else{ 

01 =0 

02 = 1 

} 

return {o1:o2} 

} 

4.7.3.2 Backward Propagation 
&& Operator: 

/* operand = {l:h}, result = {o1:o2} 7 

list raceBackBoolAndlnterval(result, operand, numBits, sign) { 

retList = 0 

if (result =={0:0}&& 
operand does not have 0) { 

retList = list containing only {0:0} 

} 

else{ 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
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maxlnterval = {minLow : maxHigh} 
if (result == {1:1}) { 
retList = List of intervals resulting by excluding 0 
from maxlnterval 

} 

else if (result == {0:1}) { 
retList = list containing only maxlnterval 

} 

} 

return retList 

} 

|| Operator: 

/* operand = {l:h}, result = {o1:o2} 7 

list raceBackBoolOrlnterval(result, operand, numBits, sign) { 

retList = 0 

if (result == {0:0}) { 

retList = list containing only {0:0} 

} 

else{ 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
maxlnterval = {minLow : maxHigh} 
if (result == {1 :1} && operand == {0:0}) { 
retList = List of intervals resulting by excluding 0 
from maxlnterval 

} 

else if (result == {0:1}) { 
retList = List containing only maxlnterval 

} 

} 

return retList 

} 

! Operator: 

/* result = {o1:o2} 7 

list raceBackBoolNegatelntervai(result, numBits, sign) { 
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retList = 0 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
maxlnterval = {minLow : maxHigh} 
5 if (result == {0:0}) { 

retList = list of intervals resulting by excluding 0 
from maxlnterval 

} 

else if (result == {1:1}{ 
1 0 retList = list containing only {0:0} 

} 

else if (result == {0:1}) { 

retList = list containing only maxlnterval 

} 

1 5 return retList 

} 



4.7.4 Unary Reduction Operators 

4.7.4.1 Forward Propagation 

20 & Operator: 

I* operand = {l:h} */ 

racelnterval raceUnaryAndlnterval(operand) { 

if (all bits of operand are 1 ) { 
retlnterval = {1:1} 

25 } 

else if (operand does not contain the "all ones" value) { 
retlnterval = {0:0} 

} 

else{ 

30 retlnterval = {0:1} 

} 

return retlnterval 

} 

| Operator: 
35 I* operand = {l:h} *l 
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racelnterval raceUnaryOrlntervai(operand) { 

if (operand == {0:0}) { 
retlnterval = {0:0} 

} 

5 else if (operand does not contain the 0 value) { 

retlnterval ={1:1} 

} 

else{ 

retlnterval = {0:1} 

10 } 

return retlnterval 

} 

A Operator: 

/* operand = {l:h} 7 
1 5 racelnterval raceUnaryXorlnterval(operand) { 

retlnterval = {0:1} 
if(l==h){ 

if (I has odd number of ones) { 
retlnterval = {1:1} 

20 } 

else if (I has even number of ones) { 
retlnterval = {0:0} 

} 

} 

25 return retlnterval 

} 

~& Operator: 

~&{I1 :M}is algorithmically modeled as [ ! (&{I1 : M })] 

~| Operator: 

30 ~\{I1:M} is algorithmically modeled as [I : M })] 

~ A Operator: 

~ A {11 : M } is algorithmically modeled as :M})] 

4.7.4.2 Backward Propagation 
35 & Operator: 

/* result = {o1:o2} 7 
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list raceBackUnaryAndlnterval(result, numBits, sign) { 

retList = 0 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
5 maxlnterval = {minLow : maxHigh} 

if (result =={1:1}){ 

retList = list containing only one interval {p:p}, where 
p is a value with all bits = 1 

} 

10 else if (result == {0:0}) { 

retList = list of intervals resulting by excluding {p:p} from 
maxlnterval, where p is a value with all bits = 1 

} 

else if (result = {0:1}) { 
1 5 retList = list containing only maxlnterval 

} 

return retList 

} 

| Operator: 
20 /* result = {o1:o2}*l 

list raceBackUnaryOrlnterval(result y numBits, sign) { 

retList = 0 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
25 maxlnterval = {minLow : maxHigh} 

if (result =={0:0}){ 

retList = list containing only one interval {p:p}, where 
p is a value with al! bits = 0 

} 

30 else if (result = {1:1}){ 

retList = list of intervals resulting by excluding {p:p} from 
maxlnterval, where p is a value with all bits = 0 

} 

else if (result == {0:1}) { 
35 retList = list containing only maxlnterval 

} 
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return retList 

} 

A Operator: 

/* result = {o1:o2}*l 

5 I* In this case, given that the precise solution may result in many split intervals (for 

example, all intervals with values that have even number of ones or odd number of 
ones), we conservatively return the maxlnterval 

7 

list raceBackllnaryXorlnterval(result, numBits, sign) { 

1 0 minLow = Minimum value for numBits and sign 

maxHigh = Maximum value for numBits and sign 
maxlnterval = {minLow : maxHigh} 
retList = list containing only maxlnterval 
return retList 

15 } 
-& Operator: 

~& {11 : M } is algorithmically modeled as [ ! : M })] 

~| Operator: 

~\{H:h1}is algorithmically modeled as [ ! (\{I1 : M })] 

20 ~ A Operator: 

~ A { 11 : M } is algorithmically modeled as [ ! ( A {11 : M })] 



4.7.5 Shift Operators 

25 4.7.5.1 Forward Propagation 

« Operator: 

/* Ihslnterval = {11 : M }, rhslnterval = {12 : h2 } 7 
racelnterval raceLeftShiftlnterval(lhslnterval, rhslnterval) { 

numBits = precision of 11 
30 if (11 is positive) { 

IhsShift = left shift 11 by 12 in (2*numBits) precision 

} 

else{ 

IhsShift = left shift 11 by h2 in (2*numBits) precision 

35 } 

lowData = IhsShift expressed in numBits precision 
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if(lowData!=lhsShift){ 
lowData = 0 

} 

numBits = precision of hi 
5 if (hi is positive) { 

IhsShift = left shift hi by h2 in (2*numBits) precision 

} 

else{ 

IhsShift = left shift hi by 12 in (2*numBits) precision 

10 } 

highData = IhsShift expressed in numBits precision 
if(highData!= IhsShift) { 
highData = 0 

} 

15 if (lowData&& highData) { 

return { lowData : highData } 

} 

else { 

minLow = Minimum value for numBits and sign 
20 maxHigh = Maximum value for numBits and sign 

return {minLow : maxHigh} 

} 

} 



25 » Operator: 

r Ihslnterval = {11 : M }, rhslnterval = {12 : h2 } */ 

racelnterval raceRightShiftlnterval(lhslnterval, rhslnterval) { 

if ({11 :h1} = {positive:positive}) { 
{o1:o2} = {H »h2:h1 »I2} 

30 } 

else if ({11 :h1} = {negative:negative}) { 
if(l2==0){ 
if (h2 == 0) { 
{o1:o2} = {H:h1} 

35 } 

else{ 
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{o1:o2} = {H:h1 » 1} 

} 

} 

else{ 

5 {o1 :o2> = {11 » h2 : hi » 12} 

} 

} 

else if ({11 :h1} = {negativepositive}) { 
if(l2 ==0){ 
10 if (h2 == 0) { 

{o1:o2} = {M:h1} 

} 

else{ 

{o1:o2} = {H :-1 »1} 

15 } 

} 

else{ 
{o1:o2} = {0:-1 » 1} 

} 

20 } 

return {o1 :o2} 

} 

4.7.5.2 Backward Propagation 

All backward propagations across all shift operators conservatively return 
25 the maximum interval for the precision and sign used in the propagation. 



4.7.6 Concatenation Operators 

4.7.6.1 Forward Propagation 

{ } Operator: 

30 /* Ihslnterval = {11 : M }, rhslnterval = {l2:h2},p = precision of rhslnterval 7 

racelnterval raceConcatenatelnterval(lhslnterval, rhslnterval) { 

if (rhslnterval has both negative and positive elements) { 

01 = 11 concatenated with p number of 0s 

02 = hi concatenated with p number of 0s 
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} 

else { 

01 = 11 concatenated with 12 

02 = h2 concatenated with h2 

} 

return {o1 : o2} 

} 

{ } Repetition Operator: 

/* Ihslnterval = {11 : M I rhslnterval = {m:m}*l 

list raceConcatenateReplnterval(lhslnterval, rhslnterval) { 

retList = 0 

newPrecision = precision of Ihslnterval * m 
p = precision of Ihslnterval 

offset = raceGetConcatenateRepOffset(m, p, newPrecision) 
IhsList = list of intervals by splitting Ihslntervals into completely 

positive intervals or completely negative intervals 
foreach interval, mylnt, in IhsList { 

lowerBound = raceGetConcatenateRepValue(mylnt.low, offset, 

newPrecision) 

upperBound = raceGetConcatenateRepValue(mylnt.high, offset, 

newPrecision) 

1 . v = lowerBound + offset evaluated in newPrecision 

2. newlnterval = {v : v} 

3. Append newlnterval to retList 

4. lowerBound = v 

5. if v != upperBound goto Step 1 

} 

return retList 

} 

raceDataType raceConcatenateRepOffset(rhsValue, IhsPrecision, 
newPrecision) { 

m = rhsValue 

p = IhsPrecision 

offset = 2 A ((m-1 )p) + 2 A ((m-2)p) + ... + 2 A ((m-(m-1 ))p) + 1 
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Express offset in newPrecision number of bits 
return offset 

} 

5 raceDataType raceConcatenateRepValue(myValue, offset, newPrecision) { 

if (myValue is negative) { 

retData = ((myValue + 1 ) * offset) - 1 

} 

else{ 

1 0 retData = myValue * offset 

} 

Express retData in newPrecision number of bits 
return retData 

} 

15 



4.7.6.2 Backward Propagation 
20 { } Operator: 

r result = {o1 : o2 }, rhslnterval = {12 : h2 } 7 

list raceBackLhsConcatenate!nterval(result, rhslnterval, numBits, sign) { 

retList = 0 

if (precision of result == precision of rhslnterval + numBits) { 
25 11 = o1 right shifted by precision of rhslnterval and expressed in 

numBits precision 
12 = o2 right shifted by precision of rhslnterval and expressed in 

numBits precision 
retList = list containing only {11 : 12} 

30 } 

return retList 

} 

r result = { o1 : o2 }, Ihslnterval = {11 :M} 7 

list raceBackRhsC ncatenatelnt rval(result, Ihslnt rval, numBits, sign) { 

35 retList = 0 
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if (precision of result == precision of Ihslnterval + numBits) { 

11 = o1 expressed in numBits precision 

12 = o2 expressed in numBits precision 
rf(H>l2){ 

retList = list of intervals that wrap-around from 12 to 11 in 
numBits precision 

} 

else{ 

retList = list containing only {11 : 12} 

} 

} 

return retList 

} 



{ } Repetition Operator: 

/* result = {o1 : o2}*l 

list raceBackLhsConcatenateReplnterval(result, numBits, sign) { 

retList = list containing only one interval that is the result 

interval truncated to numBits precision, 
return retList 

} 

4.7.7 Conditional Operator 

4.7.7.1 Forward Propagation 

I* datal Interval = {11 :h1), data2lnterval = {I2:h2}, control Interval = {I3:h3} */ 
list raceMuxlnterval(data1 Interval, data2lnterval, controllnterval) { 

if (controllnterval == {0:0}) { 

retList = list containing only data2lnterval 

} 

else if (controllnterval does not have a 0) { 
retList = list containing only datal Interval 

} 

else{ 

retList = list containing only (datal Interval (J data2lnterval) 

} 
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return retList 

} 



4.7.7.2 Backward Propagation 

5 Backward propagation to data inputs: 

r result = {o1 :o2}, controllnt = {I3:h3} 7 

list raceBackDataMuxlnterval(result, controllnt, numlnput, numBits, sign) { 

if ((numlnput == 1 && controllnt does not have a 0) || 
(numlnput == 2 && controllnt == {0:0})) { 
1 0 retList = list containing only result interpreted in numBits 

precision 

} 

else if (numlnput == 1 || numlnput == 0) { 

minLow = Minimum value for numBits and sign 
1 5 maxHigh = Maximum value for numBits and sign 

maxlnterval = {minLow : maxHigh} 
retList = list containing only maxlnterval 

} 

return retList 

20 } 

Backward propagation to control input: 

I* result = {o1 :o2}, datal Interval = {11 :h1}, data2lnterval = {I2:h2} 7 

list raceBackControlMuxlnterval(result, datal Interval, data2lnterval, 

25 numBits, sign) { 

int1 = racelntersectlnterval(result, datal Interval) 
int2 = racelntersectlnterval(result, data2lnterval) 
minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
30 maxlnterval = {minLow : maxHigh} 

if(int1 &&int2){ 

retList = list containing only maxlnterval 

} 

else if(int1 && !int2){ 

35 retList = list of intervals resulting by excluding 0 from maxlnterval 
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} 

else if (!int1 && int2){ 

retList = list containing only {0:0} 

} 

5 else { 

retList = 0 

} 

return retList 

) 

10 

4.7.8 Bit Slice Operator 

4.7.8.1 Forward Propagation 

r datalnterval = {11 :h1>, startlnterval = {I2:h2}, endlnterval = {I3:h3} 7 
list raceBitSlicelnterval(datalnterval, startlnterval, endlnterval) { 

shiftlnt = raceRightShiftlnterval(datalnterval, endlnterval) 
nBitsInt = {(12-13+1) .(12-13+1)} 
testlnt = raceRightShiftlnterval(shiftlnt, nBitsInt) 
if (testlnt is not a singleton value interval) { 
modData = {2 fl2 ^ 1) :2 (l * 3+1 >} 
modlnt = raceModulolnterval(shiftlnt, modData) 
retList = list of intervals by changing precision of 
modlnt to (12-13+1) bits 

} 

else { 

retList = list of intervals by changing precision of shiftlnt 
to (12-13+1) bits 

} 

return retList 

} 

4.7.8.2 Backward Propagation 
I* result = {o1:o2} 7 

I* In this case, given the absence of the V value in our representation, we 
conservatively return the maxlnterval. This problem is mitigated using a special bit- 
35 slice handling algorithm described in Section 3.6.1 . 
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7 

list raceBackBitSlicelnterval(result, numBits, sign) { 

minLow = Minimum value for numBits and sign 
maxHigh = Maximum value for numBits and sign 
5 maxlnterval = {minLow : maxHigh} 

retList = list containing only maxlnterval 
return retList 

} 



10 5. HARDWARE ENVIRONMENT 

The constraint set solving architecture of the present invention can be 
executed within a computing environment (or data processing system) such as 
that of Figure 15. Figure 15 depicts a workstation computer 1600 comprising a 
Central Processing Unit (CPU) 1601 (or other appropriate processor or 

15 processors) and a memory 1602. Memory 1602 has a portion of its memory in 
which is stored the software tools (or computer programs) and data of the 
present invention. While memory 1603 is depicted as a single region, those of 
ordinary skill in the art will appreciate that, in fact, such software may be 
distributed over several memory regions or several computers. Furthermore, 

20 depending upon the computer's memory organization (such as virtual memory), 
memory 1602 may comprise several types of memory (including cache, random 
access memory, hard disk and networked file server). Computer 1600 can be 
equipped with a display monitor 1605, a mouse pointing device 1604 and a 
keyboard 1606 to provide interactivity between the software of the present 

25 invention and the chip designer. Computer 1600 also includes a way of reading 
computer readable instructions from a computer readable medium 1607, via a 
medium reader 1608, into the memory 1602. Computer 1600 also includes a 
way of reading computer readable instructions via the Internet (or other network) 
through network interface 1609. 

30 In one embodiment, the processes for solving constraints can be 

implemented within software produced by Synopsys, Inc., of Mountain View, 
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California, USA. Examples of such Synopsys software are: OpenVera High 
Level Verification Language (including its associated electronic design 
automation software) and VCS HDL Simulator. In some embodiments, computer 
programs embodying the present invention are stored in a computer readable 
5 medium, e.g. CD-ROM or DVD. In other embodiments, the computer programs 
are embodied in an electromagnetic carrier wave. For example, the 
electromagnetic carrier wave may include the programs being accessed over a 
network. 



10 While the invention has been described in conjunction with specific 

embodiments, it is evident that many alternatives, modifications and variations 
will be apparent to those skilled in the art in light of the foregoing description. 
Accordingly, it is intended to embrace all such alternatives, modifications and 
variations as fall within the spirit and scope of the appended claims and 

15 equivalents. 
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